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(57) The relation between the edit resultant clip and 
the dip to be edited is managed with the hierarchical 
structure by managing means, so that the complicate 
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editing works can be easily performed if the editing 
works are performed based on the information stored in 
the managing means. 
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Description 

Technical Field 

The present invention relates to an editing system, 
and more particularly, is applicable to an editing system 
for performing edit processing by using a plurality of 
materials. 

Background Arts 

Recently, in the field of postproduction which edits 
the video data obtained from a video camera, a nonlin- 
ear editing system which uses a disc as a recording 
medium for recording the data of materials has been 
proposed. There are various types of edit processing as 
an editing processing performed in the nonlinear editing 
system. For example, they are the video edit processing 
for combining a plurality of materials to produce a 
desired video program, the composite processing for 
composing a plurality of materials by key signal, the 
special effect processing for applying the special effects 
to materials, and so on. Generally, the video edit 
processing is performed at an editing device, the com- 
posite processing is performed at a video switcher, and 
the special effect processing is performed at a special 
effect device. 

In recent years, the development of a disc recording 
medium in its random access function makes it possible 
to access to a plurality of channels simultaneously As a 
result, the edit processing for processing video data of a 
plurality of channels in real time has been desired. For 
example, in the television world in which television com- 
mercial messages are edited and produced or in the 
movie world in which movie programs are edited and 
produced, it is desired to use a dozens of materials to 
several hundred materials and to combine some differ- 
ent edit processings. More over, it is required to produce 
a complicated and high degree of edit resultant data by 
performing the several kinds of edit processing repeat- 
edly. 

To produce the complicated and high degree of edit 
resultant data, it is needed to control a dozen of materi- 
als to several hundred materials and to store the history 
of the edit processing. 

However, in a conventional editing system, there is 
no device for controlling a lot of materials and no device 
for storing the edit history, so that the editing operation 
has became complicated. More specifically, an edit 
operator (hereinafter, referred to as "operator" shortly) 
can not remember the information that which material 
has been used and which edit processing has been per- 
formed when the edit resultant video data has been pro- 
duced. Therefore, in the conventional editing system, 
the operator has managed the information by writing in 
a paper whenever the editing is performed. Further, in 
the case of the complicated edit processing such that a 
newly edit resultant video data is repeatedly produced 



from a plurality of edit resultant video data, the informa- 
tion of the editing history that which of materials is the 
final edit resultant video data produced from becomes 
large size of data, so that it has been impossible for the 
5 operator to manage the information by writing in a 
paper. 

Also, in the conventional editing system, the opera- 
tor needs to operate the device corresponding to the 
edit processing for each edit processing. Therefore, the 

10 edit works become complicated terribly. For instance, 
when two video data are composed, the operator needs 
to operate a control panel connected to a switcher 
device. When the special effect is applied to video data, 
the operator needs to operate a key board of the special 

is effect device. There has been a problem that the device 
to be operated is changed in accordance with the edit 
processing so as to take much time to edit. 

Disclosure of Invention 

20 

This invention is to solve the problems described 
above, and to provide an editing system which can real- 
ize the simplified and high-speed edit by managing a 
plurality of materials with the original hierarchical struc- 

25 ture. Further, based on the management information, 
this invention is to realize the simplified and high-speed 
edit by managing a plurality of materials to be the most 
suitable for the edit processing. 

Further, this invention is to provide an editing sys- 

30 tern which can perform various edit processings such as 
the edit processing, composite processing and special 
effect processing by manipulating one computer without 
operating respective devices by an operator. Also, this 
invention is to provide an editing system for producing 

35 the complicated and high degree of edit resultant data 
which can not be realized by a conventional editing sys- 
tem. Furthermore, this invention is to provide an editing 
system having the optimum Graphical User Interface 
(GUI) to manage a plurality of materials with the hierar- 

40 chical structure and to produce the complicated and 
high degree of the edit resultant data. The GUI simpli- 
fies the edit works and improves the usage of the edit 
operation. 

To solve the above problems, according to this 
45 invention, an editing system for producing the edit 
resultant dip from a plurality of dips to be edited is pro- 
vided with editing means, which consists of a plurality of 
processing modules for editing the dips to be edited, for 
produdng the edit resultant dip by performing the edit 
so processing corresponding to the processing module 
selected among from the plurality of processing mod- 
ules on the plurality of clips to be edited, managing 
means for managing with the hierarchical structure the 
edit resultant clip and the plurality of clips to be edited in 
55 order to show that which of clips to be edited is the edit 
resultant clip produced from, and control means for con- 
trolling the editing means based on the information 
managed by the managing means. 
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The relation between the edit resultant clip and the 
clips to be edited can be obtained by managing means. 
Thus, the edit resultant clip is produced based on the 
information showing the relation between the clips kept 
in the managing means, so as to perform the compli- 5 
cated edit works easily. 

Further, according to this invention, the editing sys- 
tem for editing a plurality of clips to be edited is provided 
with editing means, which consists of a plurality of 
processing modules for editing the clips to be edited, for 10 
producing the edit resultant clip by performing the edit 
processing corresponding to the processing module 
selected among from the plurality of processing mod- 
ules on the plurality of clips to be edited, display means 
for displaying the graphical user interface corresponding 15 
to the plurality of processing modules on a display, stor- 
ing means for storing image processing data showing 
the content of image processing performed by the edit 
processing applied to the video data of the clips to be 
edited, correspondingly to the edit resultant clip, and 20 
control means for controlling the display means to dis- 
play the image processing data stored in the storing 
means which corresponds to the selected edit resultant 
clip on a display as a part of the graphical user interface 
when the edit resultant clip is selected. 25 

When the edit resultant clip is selected, the image 
processing data showing the content of the image 
processing is displayed on a display as a part of the 
graphical user interface, so that the edit operator looks 
at the display to understand the content of the specified 20 
image processing easily. 

Brief Description of Drawings 

Fig. 1 shows a block diagram showing the construe- 35 
tion of an editing system according to the present 
invention; 

Fig. 2 is a block diagram showing the internal con- 
struction of the work station being the main con- 
struction of the editing system; 40 
Fig. 3 is a schematic diagram showing modules and 
clip database provided in the editing system 
according to the present invention; 
Fig. 4 is a schematic diagram explaining the hierar- 
chical management of clips; & 
Fig. 5 is a schematic diagram explaining the image 
of composite processing; 

Fig. 6 is a screen image explaining the video image 
produced by the composite processing; 
Fig. 7 is a schematic diagram explaining the con- so 
cept of the composite processing; 
Fig. 8 is a schematic diagram explaining the con- 
cept of the special effect processing; 
Fig. 9 is a schematic diagram explaining the con- 
cept of the edit processing; 55 
Fig. 10 is a screen image showing the GUI screen 
displayed when the composite module is started 
up; 



Fig. 1 1 is a screen image showing the GUI screen 
displayed when the special effect module is started 
up; 

Fig. 12 is a screen image showing the GUI screen 
displayed when the edit module is started up; 
Fig. 13 is a table showing a database for clip man- 
agement data registered in a clip database; 
Fig. 14 is a table explaining the database when the 
clip management data which already has been reg- 
istered is modified; 

Fig. 15 is a table showing the editing point data in 

the composite processing; 

Fig. 16 is a table showing the editing point data in 

the special effect processing; 

Fig. 17 is a table showing the editing point data in 

the edit processing; 

Fig. 1 8 is a table showing the composite data in the 
composition processing; 

Fig. 19 is a table showing the special effect data at 

the special effect processing; 

Fig. 20 is a table showing the editing data in the edit 

processing; 

Fig. 21 is a flowchart explaining the operation when 

the control module is started up; 

Fig. 22 is a flowchart explaining the operation when 

the edit module is started up; 

Fig. 23 is a flowchart explaining the operation when 

the composite module is started up; 

Fig. 24 is a flowchart explaining the operation when 

the special effect module is started up; 

Fig. 25 is a flowchart explaining the operation in the 

edition processing; 

Fig. 26 is a schematic diagram explaining an arbi- 
trary resultant clip when the content of edit is modi- 
fied; 

Fig. 27 is a flowchart explaining the operation when 
the other module is started up during a predeter- 
mined module has been started up; 
Fig. 28 is a flowchart explaining the operation in the 
re-execution processing; and 
Fig. 29 is a schematic cfiagram showing the re-exe- 
cution processing schematically. 

Best Mode for Carrying Out the Invention 

(1) The whole construction of editing system 

First the whole construction of the editing system 
of this invention will be described referring to Fig. 1 . 

In Fig. 1. 1 shows the editing system according to 
this invention, which has a work station 2 for controlling 
the system entirely. The work station 2 has a body 2A 
provided with a central processing unit (CPU), various 
processing circuits, a floppy disc drive, a hard disk drive, 
and so on. a display 2B connected to the body 2A, a key 
board 2C, a mouse 2D, and a pen tablet 2E. In the work 
station 2, an application software for editing has been 
previously installed in the hard disk drive. The appHca- 



3 



5 



EP 0 863 510 A1 



6 



tion software is operated under the operating system, 
so as to start up as a computer for editing. 

In connection, when the application software is 
operated, the graphic display for the graphical user 
interface (GUI) is displayed on the display 2B. If a 
desired graphic display displayed on the display 2B is 
selected by using the pen tablet 2E or the mouse 2D 
described above, the desired edit command can be 
input to the work station 2. Various numeral data relat- 
ing to edit can also be input to the work station 2 through 
the key board 2C. 

In addition, when the edit command or various 
numeral data is input by an operator, the work station 2 
outputs control data in accordance with the edit com- 
mand or various numeral data to a device controller 3 
described later. In this way, respective devices compos- 
ing the editing system 1 are controlled through the 
device controller 3. However, a part of the function of a 
video disk recorder 5 is directly controlled without the 
device controller 3. 

Further, video data is input to the work station 2 
through the device controller 3, so that the image of edit 
material or the image after edit can be displayed on the 
display 2B. 

The device controller 3 is a control device for 
receiving the control data from the work station 2 and 
actually controlling respective devices. The exclusive 
controller 4 having dial operation keys or slide operation 
keys is connected to the device controller 3, so that the 
gradually-changing control data which can not be input 
from the key board 2C, the mouse 2D, or the pen tablet 
2E of the work station 2 can be also input in the editing 
system t. 

The device controller 3 receives the control data 
from the work station 2 or the exclusive controller 4 to 
control the devices corresponding to the control data. 
For example, the device controller 3 instructs the video 
disk recorder 5 to reproduce a material and record the 
material after edit The video disk recorder 5 instructed 
reproduces the video data or audio data of the desired 
material which has been stored in the internal disc 
recording medium to output it, and records the edited 
video data or audio data in the disc recording medium, 
in accordance with the instruction. 

Similarly, the device controller 3 instructs the video 
tape recorder (VTR) 6 to reproduce a material. The 
instructed video tape recorder 6 reproduces the video 
data or audio data of the desired material which has 
been stored in the internal video tape to output it, in 
accordance with the instruction. In addition, in the edit- 
ing system 1 , the video data recorded in the video tape 
recorder 6 is manipulated as video data of the material, 
after being down-loaded once in the video disk recorder 
5. 

Further, the device controller 3 instructs the 
switcher 7 to select the video data output from the video 
tape recorder 6 or a video camera 8. The instructed 
switcher 7 selects the input video data of the desired 



material to output it to a digital multi-effector 9 and to 
output to the work station 2 through the device controller 
3, successively selects the input video data of the 
desired video data to combine them, or outputs the 
5 edited video data to display it on a monitor 10, and 
returns the edited video data to the video disk recorder 
5 to record it, in accordance with the instruction. 

Further, the device controller 3 instructs the digital 
multi-effector 9 to perform various effect processing. 
10 The instructed digital multi-effector 9 performs on the 
input video data of the desired material the special 
effect processing such as the mosaic processing and 
the three-dimensional transform processing, effect 
processing such as the transition effect, and the image 
is composite processing. The obtained video data is 
returned to the switcher 7 again and is output to the 
work station 2, the monitor 10, and the video disk 
recorder 5, in accordance with the instruction. 

Further, the device controller 3 instructs an audio 
20 mixer 1 1 to edit the audio data output from the video 
disk recorder 5 or the video tape recorder 6. The 
instructed audio mixer 1 1 composes (mixes) the desired 
audio material, and returns the composed audio data to 
the video disk recorder 5 to be recorded, in accordance 
25 with the instruction. 

In this way, in the edting system 1 having the con- 
struction described above, the desired edit command is 
input through the work station 2, so that the complicated 
and high-degree of desired video data can be produced 
30 easily by using the video data of a plurality of various 
materials which have been recorded in the video disk 
recorder 5 or the video tape recorder 6. Thus, if an oper- 
ator does not directly operate respective devices con- 
sisting the editing system, the various edits can be 
35 performed by only operating the work station 2. There- 
fore, the works of edit can be reduced comparing to the 
conventional system, and the usage of the editing sys- 
tem can be improved. 

40 (2) The construction of the work station 

In this paragraph, the construction of the work sta- 
tion 2 which is the central existence of the editing sys- 
tem 1 will be described. As shown in Fig. 2, the work 

45 station 2 has a system bus 20 for transmitting the com- 
mand data and the video data, a CPU 21 for controlling 
the work station 2 entirely, a video processor 22 for per- 
forming image processing on the video data S1 sup- 
plied from the device controller 3. a display controller 23 

so for managing the video data displayed on the display 2B 
and the graphic display for the GUI, an HDD interface 24 
for controlling a local hard disk drive (local HDD) 24A, a 
FDD interface 25 for controlling a floppy disc drive 
(FDD) 25A, a pointing device interface 26 for producing 

55 the control command based on the command input from 
the pointing device such as the key board 2C, the 
mouse 2D, and the pen tablet 2E, and an external inter- 
face 27 having the software driver for outputting the con- 
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trol data S2 to the device controller 3. 

The system bus 20 is a bus to transmit the video 
data, command data, address data, etc. in the work sta- 
tion 2, and is composed of an image data bus 20A for 
transmitting the video data and a command data bus 
20B for transmitting the command data and the address 
data. 

The CPU 21, the video processor 22, the display 
controller 23, the HDD interface 24, and the FDD inter- 
face 25 are connected to the image data bus 20A. The 
CPU 21, the video processor 22, the display controller 
23, the HDD interface 24, and the FDD interface 25 
transmit the video data through the image data bus 20A. 

On the other hand, the CPU 21, the video proces- 
sor 22, the display controller 23, the HDD interface 24, 
the FDD interface 25, the pointing device interface 26, 
and the external interface 27 are connected to the com- 
mand data bus 20B (that is, all blocks in the work station 
2 are connected)- The command data and the address 
data are transmitted through the command data bus 
20B. 

The CPU 21 is a block for controlling the work sta- 
tion 2 entirely, and has a ROM 21 A in which the operat- 
ing system of the work station 2 is stored and a RAM 
21 B in which the up-loaded application software and 
database are stored. To start up the work station 2, the 
CPU 21 operates based on the operating system stored 
in the ROM 21 A so as to start up it. To drive the applica- 
tion software under the operating system started up, the 
CPU 21 firstly reads the application software recorded 
in the hard disk of the hard disk drive 24A to up-load it 
on the RAM 21 B, thereafter, the application software is 
executed to be driven. 

In addition, the application software is divided into 
modules according to their function. As described later, 
when roughly divided, the application software is com- 
posed of the edit module for combining the materials, 
the composite module for composing the materials such 
like superimposing, the special effect module for apply- 
ing special effects to the materials such like the three- 
dimensional transform, and the control module for con- 
trolling the starting up of the modules and the data 
transfer. More specif icaliy, in the system, when the 
application software is started up, firstly the control 
module is started up. Then, when the instruction is input 
from an operator to edit, the corresponding module is 
suitably started up under the control of the control mod- 
ule, so as to perform the edit instructed by the operator. 

The video processor 22 is a block for receiving the 
video data S1 of the Serial Digital Interface (SDI) stand- 
ard input to the work station 2 and converting the video 
data SI, which is buffered temporarily therein. More 
specifically, the video processor 22 is composed of a 
processor controller 22A for controlling the video proc- 
essor entirely, a data converting part 22B for extracting 
the composite video signal from the pay load part of the 
received video data S1 and for converting the compos- 
ite video signal into the digital component video data, 



and a frame memory 22C for storing the video data of 
several frames output from the data converting part 22B 
temporarily. 

The processor controller 22A outputs the control 
5 signal to the data converting part 22B to control the data 
converting operation of the data converting part 22B, 
and makes the data converting part 22B to extract time 
code from the video data SI. Further, the processor 
controller 22A outputs the control signal to the frame 
10 memory 22C to control the read/write timing and the 
read/write address of the frame memory 22C. In con- 
nection, as to the read timing, the processor controller 
22A controls the read timing of the frame memory 22C 
so that the time code output to the dsplay controller 23 
75 corresponds to the video data (frame data). 

The data converting part 22B converts the compos- 
ite video signal into the digital component video data 
based on the control signal from the processor control- 
ler 22A. In connection, the time code is extracted in this 
20 converting process. The obtained video data is output to 
the frame memory 22C as described above, and the 
extracted time code is output to the processor controller 
22A. 

The frame memory 22C stores the video data sup- 
25 plied from the data converting part 22B temporarily. The 
read/write timing of the frame memory 22C is controlled 
by the processor controller 22A as described above. 
The frame memory 22C is composed of at least two 
frames, and can store the video data for at least two 
30 frames. 

The video data stored in the frame memory 22C is 
read out based on the read control of the processor con- 
troller 22A. The all pixels of the video data stored in the 
frame memory 22C is not read out but the data is 
35 thinned out for each predetermined interval and read 
out so that the size of image is smaller than that of the 
original image. The converted video data having smaller 
size of image is output to the display controller 23 
through the image data bus 20A, in order to be dis- 
40 played at the predetermined display area of the display 
2B as an image for confirmation of the materials or 
edited result. 

The display controller 23 is a block for controlling 
the data to be displayed on the display 2B. The display 
45 controller 23 has a memory controller 23A and a video 
random access memory (VRAM) 23B. The memory 
controller 23A controls the reaoVwrite timing of the 
VRAM 23B in accordance with the internal synchroniza- 
tion of the work station 2. In the VRAM 23, the video 
so data output from the frame memory 22C of the video 
processor 22 and the image data produced by the CPU 
21 are stored based on the timing control signal from 
the memory controller 23A. The video data and image 
data stored in the VRAM 23B are read out based on the 
55 timing control signal from the memory controller 23A in 
accordance with the internal synchronization of the 
work station 2, to be displayed on the display 2B. 

At this time, the graphic display of the image data 
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becomes to the graphic display for the GUI. In connec- 
tion, the image data output from the CPU 21 to the 
VRAM 23B is the image data such as windows, cursor, 
scroll bars, and icons showing devices. 

Thus, in the work station 2, the image data and the ; 
video data are displayed on the display 2B, so that the 
GUI for the operator and the image of materials or 
edited result are displayed on the display 2B. 

Trie HDD interface 24 is an interface block for com- 
municating with the local hard disk drive 24A internally 
provided in the work station 2. The HDD interface 24 
and the hard disk drive 24A communicate each other 
based on the transmission format of the Small Compu- 
ter System Interface (SCSI). 

The application software which is driven in the work 
station 2 is installed in the hard disk drive 24A. To exe- 
cute the application software, it is read out from the hard 
disk drive 24A to be up-loaded to the RAM 21 B. When 
the application software is terminated, various informa- 
tion produced by the edit operation stored in the RAM 
21 B is down-loaded to the hard disk via the hard disk 
drive 24A. 

The FDD interface 25 is an interface block for com- 
municating with the floppy disc drive 25A internally pro- 
vided in the work station 2. The FDD interface 25 and 
the floppy disc drive 25A communicate each other 
based on the transmission format of the SCSI. 

The pointing device interface 26 is an interface 
block for receiving the information from the key board 
2C, mouse 2D, and pen tablet 2E which are connected 
to the work station 2. The pointing device interface 26 
receives the input information from the buttons provided 
on the key board 2C to decode the received input infor- 
mation, and outputs it to the CPU 21. Similarly, the 
pointing device interface 26 receives the detection infor- 
mation of a two-dimensional rotary encoder provided in 
the mouse 2D and the click information of the left/right 
buttons provided on the mouse 2D (that is, the informa- 
tion selected and specified by pushing down the but- 
tons) to decode the received information, and outputs it 
to the CPU 21 . Similarly, the pointing device interface 26 
receives the two-dimensional positional data from the 
pen tablet 2E to decode the received positional data, 
and outputs it to the CPU 21 . Based on these informa- 
tion output from the pointing device interface 26. the 
CPU 21 can understand which command button is 
instructed among the GUI displayed on the display 2B. 
and understand various data input from the key board 
2C, so as to perform the corresponding control. 

The external interface 27 is a block for communicat- 
ing with the device controller 3 connected to the work 
station 2 externally. The external interface 27 has a 
driver for converting various control command such as 
reproduction command produced by the CPU 21 and 
recorcfing command into the data of a predetermined 
communication protocol, which outputs the control com- 
mand data S2 to the device controller 3 through the 
driver. 
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(3) The principle of edit in the editing system 

In this paragraph, the principle of edit in the editing 
system 1 will be explained successively. 

(3-1) Basic construction of the application software for 
edit 

In this paragraph, the basic construction of the 
application software for edit prepared in the work station 
2 will be firstly explained. As shown in Fig. 3. in the edit- 
ing system 1 , the application software for edit, which is 
divided into modules according to their function, is pre- 
pared in the work station 2. When roughly divided, the 
application software divided into modules is composed 
of the edit module EM for editing a material such like 
combining, the composite module CM for composing a 
material such like superimposing, the special effect 
module SM for applying special effects to a material, 
and the control module CNTM for controlling the starting 
up of the edit module EM, the composite module CM, 
and the special effect module SM which are divided into 
modules according to their functions. When the applica- 
tion software having such construction is up-loaded 
from the hard disk drive 24A to the RAM 21b, firstly the 
control module CNTM is started up. Then, each of the 
modules EM, CM, and SM is suitably started up under 
the control of the control module CNTM in accordance 
with the instruction from an operator. 

A clip database CDB is composed of the video disk 
recorder 5 and the RAM 21 B, and stores the video data 
of materials and various data relating to the edit. Each 
of the modules EM. CM, and SM reads out the material 
instructed by the operator from the clip database CDB, 
edits the material in accordance with the instruction of 
the operator using the hardware such as the switcher 7 
or the digital multi-effector 9 described above, and reg- 
isters the obtained material edited in the clip database 
CDB. Each of the modules EM, CM, and SM also regis- 
ters the data relating to edit such as various parameters 
used for edit in the clip database CDB. In addition, the 
dip database CDB mainly stores the video data of the 
material in the video disk recorder 5, and stores various 
data relating to edit in the RAM 21 B. 

(3-2) Definition of clip 

In the editing system 1, each material is handled 
with a unit called clip. In this paragraph, the clip will be 
described. In the editing system 1 according to this 
invention, one sequence of the video moving image 
data is defined as clip video data Data for managing 
information that how the clip video data is produced is 
defined as clip management data. Data consisting the 
clip video data and the clip management data is defined 
as clip. Further, in the editing system 1 according to this 
invention, a material produced by only cutting out from 
the source video data is called material clip (MC), and a 
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material produced by editing the material clip is called 
resultant dip (FC). 

In the editing system 1 according to this invention, a 
plurality of dips composed of the material dips and the 
resultant dips are managed with the hierarchical struc- s 
ture based on the relation between clips. Referring to an 
example of Fig. 4, the state will be explained below. 

In the example of Fig. 4, the resultant clip FC-008 is 
a clip produced by composing three material clips, the 
material clip MC-001 , the material dip MC-002, and the 10 
material clip MC-003. That is, the relations between the 
resultant dip FC-008 and the material dip MC-001 , the 
material clip MC-002, and the material dip MC-003 are 
in the relation of up and low. In the relation of up and 
low, since the material clip MC-001, the material clip 15 
MC-002, and the material clip MC-003 are under the 
resultant clip FC-008, they are called lower clips. On the 
contrary, the resultant dip FC-008 is called upper clip 
because it is produced by composing these lower dips. 

Similarly, the resultant dip FC-009 is a clip pro- 20 
duced by applying the spedal effed to the material clip 
MC-004. Therefore, the material clip MC-004 is the 
lower clip of the resultant dip FC-009. On the contrary, 
the resultant clip FC-009 is the upper clip of the material 
dip MC-004. 25 

Further, the resultant dip FC-010 is a resultant dip 
produced by editing (in this case, combining by wipe, 
etc.) the resultant clip FC-008 and the resultant dip FC- 
009. Therefore, the resultant clip FC-008 and the result- 
ant clip FC-009 are respectively the lower clips of the 30 
resultant clip FC-010. The resultant dip FC-010 is the 
upper clip of the resultant dip FC-008 and the resultant 
dip FC-009. 

In this way, the relation of up and low exists 
between respective clips. In the editing system 1 , each 35 
clip is managed with the hierarchical structure based on 
the relation of up and low between dips in the clip data- 
base CDB. In connection, the material dip which is not 
used for edit have no relation with the other dips. How- 
ever, the material dip is managed as a dip having no 40 
object to link. The example described here is one exam- 
ple and other combinations also exist as the relation of 
up and low between clips. 

(3-3) General idea of the composite processing 45 

Next in this paragraph, the general idea of the com- 
posite processing performed in the composite module 
CM will be explained. The video image of the resultant 
clip FC-008 shown in Rg. 4 is produced by composing so 
(that is the composite processing) the video images of 
the material clip MC-001, the material clip MC-002, and 
the material clip MC-003. The general idea of the com- 
posite processing is shown in Rg. 5 and Fig. 6. Rg. 5 
shows the state of composing the video images of three ss 
material dips MC-001, MC-002, and MC-003. Rg. 6 
shows the video image of the resultant clip FC-008 pro- 
duced by composing. 



In the editing system 1 according to this invention, 
in the case of composing a plurality of clips, each dip is 
regarded as one layer, and the layers are piled up so as 
to compose. In the example of Rg. 5, the material clip 
MC-003 is specified as the first layer L1, the material 
dip MC-002 is specified as the second layer L2. and the 
material dip MC-001 is specified as the third layer L3. In 
the case of composing the material clips assigned to 
respective layers L1 , l_2. and L3, the layer L1 is the low- 
est layer, and respective layers L2, L3 are successively 
piled up thereon. More specifically, the video image of 
the material dip MC-002 (e.g., image showing a human) 
specified as the second layer 12 is piled on the video 
image of the material clip MC-003 (e.g., image showing 
background) specified as the first layer L1 to compose 
them, and the video image of the material clip MC-001 
(e.g., image showing characters) specified as the third 
layer L3 is further piled up on the composed video 
image so as to compose them. By this composite 
processing, the resultant clip FC-008 of the video image 
such that three materials are superimposed as shown in 
Rg. 6 can be produced. 

In addition, Fig. 5 shows the example of composing 
the material dips MC-003, MC-002, and MC-001 
respectively assigned to three layer L1, L2, and L3. 
However, the editing system 1 of this invention can save 
ten layers at maximum, and can compose ten material 
dips respectively assigned from the first layer L1 to 
tenth layer L10. In connection, in this case, the first layer 
L1 is the lowest layer, and the tenth layer having the 
largest layer number is the uppermost layer. 

Next, referring to Rg. 7, the composite processing 
will be further explained with more details. Rg. 7 shows 
the state that the resultant clip FC-008 is produced by 
composing the material clip MC-003 specified as the 
first layer L1, the material clip MC-002 specified as the 
second layer 12, and the material clip MC-001 specified 
as the third layer L3. As shown in Rg. 7, in the resultant 
dip FC-008, the f irst editing point EP1 to the eighth edit- 
ing point EP8 are set as an edit start point of each mate- 
rial dip (which is referred to as in-point), an edit end 
point (which is referred to as out-point), and points for 
changing parameters of the composition and the image 
conversion. 

The first editing point EP1 indicates the in-point IN3 
of the material clip MC-003, the second editing point 
EP2 indicates the in-point IN2 of the material clip MC- 
002, the fourth editing point EP4 indicates the in-point 
IN1 of the material clip MC-001 . Further, the sixth edit- 
ing point EP6 indicates the out-point OUT2 of the mate- 
rial clip MC-002, the seventh editing point EP7 indicates 
the out-point OUT1 of the material dip MC-001 , and the 
eighth editing point EP8 indicates the out-point OUT3 of 
the material clip MC-003. In addition, the third editing 
point EP3 and the fifth editing point EPS are the editing 
points set for changing the composite parameter of 
each layer. Trie editing points EP3 and EPS will be 
described in details later. 
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As shown in Fig. 7, each clip has the original inter- 
nal time code starting from the head position of the 
video data of each dip. For example, the material clip 
MC-003 specified as the first layer L1 has the internal 
time line t3 starting from the head position S3 of the 
video data, the material clip MC-002 specified as the 
second layer L2 has the internal time line t2 starting 
from the head position S2 of the video data, and the 
material clip MC-001 specified as the third layer L3 has 
the internal time line t1 starting from the head position 
S1 of the video data. 

Similarly, the resultant clip FC-008 has the internal 
time line t8 starting from the head position S8 of the 
video data. The time codes of the first editing point EP1 
to the eighth ecfiting point EP8 are respectively defined 
by the time codes on the time lines t8 of the resultant 
dip FC-008. 

The in-point IN3 and out-point OUT3 of the material 
dip MC-003 are defined by the time line t3 of the mate- 
rial dip MC-003, and their time codes are "00:00:31 :02" 
and "00:05:18:02" respectively. Accordingly, the time 
code of the in-point IN3 corresponds to the time code 
"00:00:00:00" of the first editing point EP1 in the result- 
ant clip FC-008, and the time code of the out-point 
OUT3 corresponds to the time code "00:04:47:00" of 
the eighth editing point EP8 in the resultant dip FC-008. 

Similarly, The in-print IN2 and out-point OUT2 of 
the material clip MC-002 are defined by the time line t2 
of the material clip MC-002, and their time codes are 
"00:00:51:00" and "00:03:0420" respectively. Accord- 
ingly, the time code of the in-point IN2 corresponds to 
the time code "00:00:42:20" of the second editing point 
EP2 in the resultant dip FC-008, and the time code of 
the out-point OUT2 corresponds to the time code 
"00:02:59:20" of the sixth editing point EP6 in the result- 
ant clip FC-008. 

Similarly, The in-point IN1 and out-point OUT1 of 
the material clip MC-001 are defined by the time line t1 
of the material clip MC-001, and their time codes are 
"00:01:40:03" and "00:02:45:48" respectively. Accord- 
ingly, the time code of the in-point IN1 corresponds to 
the time code "00:01:56:00" of the fourth editing point 
EP4 in the resultant dip FC-008, and the time code of 
the out-point OUT1 corresponds to the time code 
"00:03:19:45" of the seventh editing point EP7 in the 
resultant clip FC-008. 

Therefore, when the resultant clip FC-008 is repro- 
duced, the video image of the material clip MC-003 is 
output during the period from the first editing point EP1 
to the second editing point EP2. The video image of 
which the material dip MC-002 is composed on the 
material dip MC-003 is output during the period from 
the second editing point EP2 to the fourth editing point 
EP4. The video image of which the material dip MC- 
002 and the material clip MC-001 are composed on the 
material dip MC-003 is output during the period from 
the fourth editing point EP4 to the sixth editing point 
EP6. The video image of which the material clip MC- 



001 is composed on the material dip MC-003 is output 
during the period from the sixth editing point EP6 to the 
seventh editing point EP7. Then, the video image of the 
material clip MC-003 is output during the period from 
5 the seventh editing point EP7 to the eighth editing point 
EP8. 

In addition, the example described here is one 
example and other combinations also exist as a combi- 
nation of clips to be composed. 

10 

(3-4) General idea of the spedal effect processing 

Next, in this paragraph, the general idea of the spe- 
dal effect processing which is performed in the special 
is effect module SM will be explained. The resultant dip 
FC-009 shown in Fig. 4 is a dip produced by applying 
the special effect to the material dip MC-004. in order to 
make it easy to understand, four special effects, the 
mosaic effect, the crop effect, the three-dimensional 
20 transform, and the trail effect are applied to the material 
dip MC-004, and the general idea of the spedal effect 
processing is explained referring to Fig. 8. 

As show in Fig. 8, in this example, to the material 
dip MC-004, the mosaic effect is specified as the first 
25 special effect E1 , the crop effect is specified as the sec- 
ond spedal effect E2, the three-dimensional transform 
is specified as the third spedal effect E3, and the trail 
effect is specified as the fourth spedal effect. 

In this case, the mosaic effect is the effect that the 
30 video image is divided into tile pieces to show it like a 
mosaic picture. In the editing system 1 according to this 
invention, parameters relating to the mosaic effect can 
be set to arbitrary values, so that the size of a tile piece 
and the aspect ratio can be set to arbitrary values. 
35 The crop effect is the effect that a part of the video 
image is cut out by reducing the picture frame, which is 
called the cut-out effect because a part of the video 
image is cut out. In the editing system 1 according to 
this invention, parameters relating to the crop effect can 
40 be set to arbitrary values, so that the position of the right 
and left side of the picture frame, the position of the top 
and bottom side of the picture frame, and the gradation 
of the edges can be set to arbitrary values. 

The three-dimensional transform is the effect that 
45 an image is virtually transformed on the three-dimen- 
sional space. For example, it is the image transform for 
rotating the image using the X-axis, Y-axis, and Z-axis 
as a shaft, and for transferring the image into the X-axis, 
Y-axis, or Z-axis direction, when the horizontal direction 
so of the image is defined as X-axis, the vertical direction is 
defined as Y-axis, and the depth direction is defined as 
Z-axis. In the editing system 1 according to this inven- 
tion, parameters relating to the three-dimensional trans- 
form can be set to arbitrary values, so that the image 
55 can be transformed arbitrarily. 

The trail effect is the effect that when the image is 
transferred spatially, the image is frozen as a still image 
for a predetermined period, and the frozen image is left 
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as an afterimage. Generally, it is called recursive effect 
In the editing system 1 according to this invention, 
parameters relating to the trail effect can be set to arbi- 
trary values, so that the period for freezing the image 
and the period for leaving the image as an afterimage 
can be set arbitrarily. 

Also in the special effect processing, as shown in 
Fig. 8, in the resultant clip FC-009, the first editing point 
EP1 to the seventh editing point EP7 are set as an edit 
start point (in-point), an edit end point (out-point), and 
the parameter changing point of the image transform. 

The first editing point EP1 indicates the in-point IN4 
of the material clip MC-004, the start point of the mosaic 
effect, and the start point of the crop effect The second 
editing point EP2 indicates the start point of the three- 
dimensional transform. The fourth editing point EP4 
indicates the start point of the trail effect The seventh 
editing point EP7 indicates the out-point OUT4 of the 
material clip MC-004, the end point of the mosaic effect 
the end point of the crop effect, the end point of the 
three-dimensional transform, and the end point of the 
trail effect In addition, the third editing point EP3, the 
fifth editing point EPS, and the sixth editing point EP6 
are editing points set to change parameters of the three- 
dimensional transform. These editing points EP3, EPS 
and EP6 will be described later. 

In the case of special effect, similar to the compos- 
ite processing, the material clip MC-004 and the result- 
ant dip FC-009 respectively have the internal time lines 
t4, t9 expressed by the original internal time codes start- 
ing from the head position of the video data of respec- 
tive clips. The time codes of the first editing point EP1 to 
the seventh editing point EP7 described above are 
defined by the time codes on the time line t9 of the 
resultant clip FC-009. 

The in-point IN4 and the out-point OUT4 of the 
material clip MC-004 are respectively defined by the 
time line t4 of the material clip MC-004. Their time 
codes are "00:10:1 2:00" and "00:12:1 8:00" respectively. 
Accordingly, the time code of the in-point IN4 corre- 
sponds to the time code "00:00:00:00" of the first editing 
point EP1 in the resultant clip FC-009, and the time 
code of the out-point OUT4 corresponds to the time 
code "00:02:06:00" of the seventh editing point EP7 in 
the resultant clip FC-009. 

Further, as shown in Fig. 8, the start point of the 
mosaic effect specified as the first special effect E1 is 
the first editing point EP1 that the time code in the 
resultant clip FC-009 is "00:00:00:00". The end point of 
the mosaic effect is the seventh editing point EP7 that 
the time code in the resultant clip FC-009 is 
"00:02:06:00". 

Similarly, as shown in Fig. 8, the start point of the 
crop effect specified as the second special effect E2 is 
the first editing point EP1 that the time code in the 
resultant clip FC-009 is "00:00:00:00". The end point of 
the crop effect is the seventh editing point EP7 that the 
time code in the resultant clip FC-009 is "00:02:06:00". 



Also, the start point of the three-dimensional trans- 
form specified as the third special effect E3 is the sec- 
ond editing point EP2 that the time code in the resultant 
clip FC-009 is "00:00:1 2:03". The end point of the three- 
5 dimensional transform is the seventh editing point EP7 
that the time code in the resultant clip FC-009 is 
"00:02:06:00". 

Also, the start point of the trail effect specified as 
the fourth special effect E4 is the fourth editing point 
10 EP4 that the time code in the resultant dip FC-009 is 
"00:01 :02:50". The end point of the trail effect is the sev- 
enth editing point EP7 that the time code in the resultant 
dip FC-009 is "00:02:06:00". 

Therefore, when the resultant clip FC-009 is repro- 
75 duced, the video image of which the mosaic effect and 
the crop effect are applied to the video image of the 
material clip MC-004 is output during the period from 
the first editing point EP1 to the second editing point 
EP2. The video image of which the mosaic effect the 
20 crop effect, and the three-dimensional transform are 
applied to the video image of the material clip MC-004 
is output during the period from the second editing point 
EP2 to the fourth editing point EP4. The video image of 
which the mosaic effect, the crop effect, the three- 
25 dimensional transform, and the trail effect are applied to 
the video image of the material clip MC-004 is output 
during the period from the fourth editing point EP4 to the 
seventh editing point EP7. 

30 (3-5) General idea of the edit processing 

In this paragraph, the general idea of the edit 
processing performed in the edit module EM will be 
explained. The resultant clip FC-010 shown in Fig. 4 is 

35 a clip produced by editing the resultant dip FC-008 and 
the resultant clip FC-009. In order to make it easy to 
understand, supposing that the edit processing is per- 
formed with the wipe effect, the general idea of the edit 
processing is explained referring to Fig. 9. 

40 As shown in Rg. 9, in this example, the resultant 
dip FC-008 is specified as the first layer L1 and the 
resultant dip FC-O09 is specified as the second layer 
L2. The wipe effect is specified as a processing of 
changing from the resultant dip FC-008 specified as the 

45 first layer L1 to the resultant dip FC-009 specified as the 
second layer L2. Note that in the edit processing, since 
the video data is not superimposed like a composite 
processing, but the video data are combined, the tem- 
porally earlier video data is specified as the f irst layer L1 

so and the temporally later video data is specified as the 
second layer L2. 

Further, the wipe effect specified as the change 
processing is a transition effect for wiping an old picture 
displayed at present with a new picture to change the 

55 picture displayed on a screen. In connection, the wipe 
effect specified in the example shown in Fig. 9 is the 
wipe effect that the picture is changed from the left side 
of the picture to the right side when the image of the 
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resultant clip FC-008 is changed into the image of the 
resultant clip FC-009. 

Also, in this edit processing, as shown in Fig. 9, in 
the resultant clip FC-010, the first editing point EP1 to 
the fifth editing point EPS are set as an edit start point 
(in-point) of each clip, an edit end point (out-point), and 
the parameter changing point of the edit. 

The first editing point EP1 indicates the in-point IN8 
of the resultant clip FC-008. The second editing point 
EP2 indicates the start point of the wipe effect and the 
in-point 1N9 of the resultant clip FC-009. The fourth edit- 
ing point EP4 indicates the end point of the wipe effect 
and the out-point OUT8 of the resultant clip FC-008. 
The fifth editing point EPS indicates the out-point OUT9 
of the resultant clip FC-009. Here, the third editing point 
EP3 is an editing point set for changing the effect 
parameters of the wipe effect The editing point EP3 will 
be described in details later. 

Similarly to the composite processing and the spe- 
cial effect processing described above, the resultant 
clips FC-008. FC-009, and FC-010 have the internal 
time lines t8. t9, and t10 expressed by the original inter- 
nal time codes starting from the head position of the 
video data of respective clips. The f irst editing point EP1 
to the fifth editing point EPS described above are 
defined by the time codes on the time line t10 of the 
resultant clip FC-010. 

The in-point IN8 and the out-point OUT8 of the 
resultant clip FC-008 are respectively defined by the 
time line t8 of the resultant clip FC-008, and the time 
codes are "00:01 :01 :20" and "00:04:43:00" respectively. 
Accordingly, the time code of the in-point IN8 corre- 
sponds to the time code "00:00:00:00" of the first editing 
point EP1 in the resultant clip FC-010. and the time 
code of the out-point OUT8 corresponds to the time 
code "00:03:42:00" of the fourth editing point EP4 in the 
resultant clip FC-010. 

Similarly, the in-point IN9 and the out-point OUT9 of 
the resultant clip FC-009 are respectively defined by the 
time line t9 of the resultant clip FC-009, and their time 
codes are "00:00:00:50" and "00:02:06:00" respectively. 
Accordingly, the time code of the in-point IN9 corre- 
sponds to the time code "00:0339:00" of the second 
editing point EP2 in the resultant clip FC-010, and the 
time code of the out-point OUT9 corresponds to the 
time code "00:05:44:10" of the fifth editing point EPS in 
the resultant clip FC-010. 

Further, the start point of the wipe effect set to 
change the image of the resultant clip FC-008 and the 
image of the resultant clip FC-009 is set to the second 
editing point EP2 in the resultant dip FC-010, and set to 
"00:03:39:00" as a time code. Also, the end point of the 
wipe effect is set to the fourth editing point EP4 in the 
resultant clip FC-010, and set to "00:03:42:00" as a time 
code. 

Therefore, when the resultant clip FC-010 is repro- 
duced, the video image of the resultant clip FC-008 is 
output during the period from the first editing point EP1 



to the second editing point EP2. The image such that 
the video image of the resultant clip FC-008 is succes- 
sively changed to the video image of the resultant clip 
FC-009 is output by the wipe effect from the left side of 
5 the screen toward the right side, during the period from 
the second editing point EP2 to the fourth editing point 
EP4. The image of the resultant clip FC-009 is output 
during the fourth editing point EP4 to the frfth editing 
point EPS. 

10 

(4) Graphic display displayed as GUI 

Next, in this paragraph, the screen of the GUI dis- 
played on the display 2B of the work station 2 when 
75 each module is started up will be explained. 

(4-1) GUI when the composite module is started up 

First, in this paragraph, the GUI when the compos- 
20 ite module CM is started up is explained. In the editing 
system 1, the graphic display shown in Fig. 10 is dis- 
played as a GUI of the composite module CM on the 
display 2B of the work station 2, when the composite 
module CM is started up. 
25 As shown in Fig. 10, when roughly divided, the GUI 
of the composite module CM is composed of a menu 
window 30, a clip tree window 31, a key window 32, a 
library window 33, a time line window 34, a parameter 
setting window 35, a preview screen display window 36, 
30 a device control window 37, an edit content display win- 
dow 38, and a control command window 39. 

The menu window 30 is an area for displaying the 
top menu prepared in the editing system 1 . In addition, 
the menu window 30 is displayed after the control mod- 
35 ule CNTM is started up. 

In the editing system 1 according to this invention, 
for example, a file read menu, an initial setting menu, 
and a module start-up menu. etc. are prepared as the 
top menu. When the file read menu is specified by push- 
40 ing down the button of the mouse 2D (hereinafter, the 
specification action using the mouse is referred to as 
click), the list of the resultant clips which have been 
already registered is displayed. A desired resultant clip 
is selected by click operation among from the list to read 
45 the edit content of the selected resultant clip onto the 
time line window 34 described later. Thus, if the result- 
ant clip already registered is modified, the file read 
menu is used to read the resultant clip, and the resultant 
clip can be modified. 
so Further, when the initial setting menu is selected by 
click operation, various setting items are read out. A 
desired item is selected among from the various items 
to display a setting screen for the selected item is dis- 
played. Thus, rf a desired item is initially set, the setting 
55 screen of the item is read out from the initial setting 
menu, and the desired value for the item can be set. 

Further, when the module start-up menu is selected 
by dick operation, the commands for starting up the 
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composite module CM, the special effect module SM, 
and the edit module EM are displayed. A desired com- 
mand is selected among from them to start up the 
selected module and the GUI corresponding to the 
module is displayed on the screen. In feet, the GUI of < 
the composite module CM shown in Fig. 10 is a screen 
obtained by starting up the composite module CM from 
the module start-up menu. 

The clip tree window 31 is an area for displaying the 
graphic display to visually obtain the hierarchical rela- 
tion of clips registered in the clip database. When the 
hierarchical relation of clips is that shown in Fig. 4, the 
clip tree shown in Fig. 10 is displayed in accordance 
with the hierarchical relation. More specifically, in this 
case, since the uppermost clip is the resultant clip FC- 
010, the clip name of the resultant clip FC-010 "FC-010" 
is displayed on the uppermost position of the clip tree 
window 31 . As a result, lower clips being linked to the 
resultant clip FC-010 at a lower position are the result- 
ant clip FC-008 and the resultant clip FC-009. The clip 
name of these lower clips "FC-008" and "FC-009" are 
displayed below the resultant clip FC-010 being an 
upper clip and displayed in parallel at the position shift- 
ing toward the right side by one stage. At this time, a line 
connecting the resultant clip FC-010 and the resultant 
clip FC-008 and a line connecting the resultant clip FC- 
010 and the resultant clip FC-009 are displayed, so as 
to show that the resultant clips FC-010, FC-008 and FC- 
009 have the hierarchical relation. 

Further, lower clips being linked to the resultant clip 
FC-008 at a lower position are the material clip MC-001 , 
the materia! clip MC-002, and the material clip MC-003. 
The clip names of the lower clips "MC-OOr. "MC-002", 
and "MC-003" are displayed below the resultant clip FC- 
008 being an upper clip and displayed in parallel at the 
position shifting toward the right side by more one 
stage. As this time, a line connecting the resultant clip 
FC-008 and the material clip MC-001 , a line connecting 
the resultant clip FC-008 and the material clip MC-002, 
and a line connecting the resultant clip FC-008 and the 
material clip MC-003 are displayed, so as to show that 
the clips FC-008, MC-001, MC-002, and MC-003 have 
the hierarchical relation. 

In the similar way, lower clips being linked to the 
resultant clip FC-009 at a lower position is the material 
clip MC-004. The dip name of the lower clip "MC-004" 
is displayed below the resultant clip FC-009 being an 
upper dip, and displayed at the position shifting toward 
the right side by one stage. As this time, a line connect- 
ing the resultant clip FC-009 and the material dip MC- 
004 is displayed, so as to show that the clips FC-009 
and MC-004 have the hierarchical relation. 

In this way, in the dip tree window 31, the clip 
names of clips are displayed like a tree, so as to imme- 
diately understand the relation between dips registered 
in a database visually. 

In addition, the dip whose dip name is surrounded 
by a frame with a bold line is a dip being displayed at 



present to be edited. Moreover, a scroll button 31A of 
the left and right direction is displayed at the bottom 
position of the clip tree window 31 . The scroll button 
31A is operated by using the mouse 2D, so that the dis- 
; played clip tree can be scrolled in the right and left direc- 
tion. 

Similarly, a scroll button 31B of the up and down 
direction is displayed at the right side position of the clip 
tree window 31. The scroll button 31 B is operated, so 
io that the displayed dip tree can be scrolled in the up and 
down diredion. 

The key window 32 is an area for displaying key 
selection buttons to designate a key processing for the 
dip to be edited. A desired button is selected among 
is from them to designate the desired key processing for 
the clip to be edited. At this time, as shown in Fig. 10, 
the key selection buttons such as a luminance key but- 
ton, a liner key button, a dean key button, a pattern key 
button, and an external key button are prepared. 
20 In this connection, the key processing is a process- 
ing of hollowing out the area based on the key signal 
from the video image and putting another image into 
there. Further, the luminance key is a key processing for 
performing a hollowing-out processing based on the 
25 luminance signal contained in the key signal. The liner 
key is a kind of the luminance key, which is a key 
processing that the^ changeable width of the gain 
becomes narrower than that of the luminance key. The 
dean key is a processing for putting the image to be put 
30 into without the hollowing-out in the key processing. 
Further, the pattern key is a key processing for cutting 
out based on the wipe pattern. The external key is a key 
processing for performing based on the key signal sup- 
plied from the external device. 

Also in the key window 32, a scroll button 32A of the 
left and right direction is displayed at the bottom position 
of the key window 32. The scroll button 32A is operated 
so that the displayed key selection buttons can be 
scrolled in the right and left direction. Similarly, a scrdl 
button 32B of the up and down direction is displayed at 
the right side position of the key window 32. The scroll 
button 32B is operated so that the displayed key selec- 
tion buttons can be scrolled in the up and down direc- 
tion. 

45 The library window 33 is an area for displaying the 
list of the material clips or the resultant dips registered 
in the clip database. A desired dip is selected among 
from the clips displayed on the library window 33 to des- 
ignate the selected clip as the clip to be edited. The 

50 library window 33 will be described in details later. 

The time line window 34 is an area for placing the 
dips to be edited on the time axis to designate the con- 
tent of edit. On the time line window 34 displayed at the 
composite module CM, the contents relating to the com- 

55 posite processing are displayed. The time line window 
34 is divided into areas. When roughly divided succes- 
sively from the top, a time code display area (Time 
Code), an editing point display area (Edit Point), a pre- 
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view extent display area (Preview), and a clip specifying 
area (L1toL10). 

The time code display area is an area for displaying 
the time code at the editing point The time code is a 
time code on the time line of the resultant clip produced 
based on the edit contents designated on the time line 
window 34. 

The editing point display area is an area for indicat- 
ing a point set as an editing point by a triangle mark. For 
example, when the composite processing shown in Fig. 
4 and Fig. 7 is specified, the edting points EP1 to EP8 
are indicated by using a triangle mark. 

The preview extent display area is an area for indi- 
cating the extent of the video data displayed on the pre- 
view screen display window 36 when a preview button 
or a view button which is described later is operated. In 
this example, the section between the editing point EP1 
and the editing point EP8 are set as the display extent 
and a bar showing the section is displayed. 

The clip specifying area is an area for specifying to 
each layer the dip to be edit to which the composite 
processing is applied. In the editing system 1 , ten layers 
of the layer L1 to the layer L10 are prepared, and the 
clip being the material of the composite processing can 
be specified to each layer. In addition, since the display 
extent of the clip specifying area is limited (as shown in 
the figure, it is for about five layers), the layers L1 to L1 0 
can not be displayed all together. However, the scroll 
button 34A displayed at the right side of the clip specify- 
ing area is operated so that the clip specifying area can 
be scrolled in the up and down direction. Therefore, a 
desired layer can be displayed. 

Among ten layers L1 to L10. the layer L1 is a layer 
for specifying the clip being the base (lowermost) image 
at the time of composite processing. The layers 12 to 
L10 are layers for specifying the clips which are piled up 
on the base image. In addition, as the number of layer 
becomes larger, the hierarchy of layer becomes higher. 
Here, the layer L10 is the highest layer. 

Each of the layers L1 to L10 is divided into a video 
area (Video) for specifying the clip to be composed and 
a key area (Key) for specifying the key processing per- 
formed on the specified clip In this case, the rectangular 
graphic image (hereinafter, referred to as ceil) indicating 
the clip is placed on the video area, so as to set the clip 
to the layer. Similarly, the cell indicating the key process- 
ing is placed on the key area, so as to set the key 
processing to the clip which is specified to the layer. 

Here, as shown in Fig. 10, to set the material clip 
MC-003 to the layer L1, the material clip MC-003 is 
clicked on the clip tree window 31 or the material clip 
MC-003 is clicked on the library window 33, so as to 
select the material clip MC-003. Such processing is per- 
formed to display the cell of the material clip MC-003. 
The cell is transferred to the video area of the layer L1 
and placed at a desired position, so that the material 
clip MC-003 is set to the layer L1 . 

Similarly, to set the external key to the layer L1 , the 



external key button is clicked on the key window 32, so 
as to select the external key. Such processing is per- 
formed to display the cell indicating the external key. 
The cell is placed at the key area of the layer L1 , so that 

5 the external key is set to the layer L1 . In connection, the 
operation of setting the clip or key processing to the lay- 
ers L2 to L10 is same as the operation of setting to the 
layer L1 described above. 

In addition, the length of the cell indicating the dip 

io corresponds to the duration (time period from the start 
to the end of dip) of the clip. The cell indicating the key 
processing makes a pair with the dip placed at the 
video area, and has the same length as the clip placed 
at the video area. The characters showing the clip name 

is or key processing name is displayed on each cell, so as 
to understand at a glance which dip or key processing 
is set 

Also, when the resultant dip placed and displayed 
at the clip specifying area is selected by double-clicking, 

20 the module which has produced the resultant clip (that 
is, the composite module CM, the special effect module 
SM, or the edit module EM) is started up, and the con- 
tent of edit performed on the resultant clip is displayed 
on the time line window of the GUI of the corresponding 

25 module. 

The parameter setting window 35 is an area for set- 
ting various parameters relating to edit. On the parame- 
ter setting window 35 displayed at the time of starting- 
up the composite module CM, the content relating to the 
30 composite processing is displayed as a matter of 
course, and as shown in Fig. 10, the graphic display for 
setting the gain of the composite processing is dis- 
played. 

In this case, the gain of the composite processing is 

35 the composite ratio when the video data is piled up. 
More specifically, when the gain is 100%. the upper 
video data is piled up on the lower video data so that the 
lower video data is completely not viewed. For example, 
when the gain is 50%, the upper video data is piled up 

40 on the lower video data so that an approximately half of 
the lower video data is viewed transparently. When the 
gain is 0%, the upper video data is piled up so that it is 
not viewed and the lower video data is completely 
viewed transparently. 

45 In addition, the horizontal axis (i.e., time axis) of the 
parameter setting window 35 corresponds to that of the 
time line window 34 described above, and the change 
point of the parameters can be determined with refer- 
ring to the contents of the composite processing sped- 

so tied on the time line window 34. In connection, 
regarding to the horizontal direction, that is the left and 
right direction, the scroll button 35A placed at the bot- 
tom side of the parameter setting window 35 is operated 
so as to scroll the graphic image of the parameter set- 

55 ting window 35 in the direction of left and right. As this 
time, since the horizontal axis of the time line window 34 
corresponds to that of the parameter setting window 35, 
the graphic image of the time line window 34 and the 
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graphic image of the parameter setting window 35 are 
linked and scrolled in the direction of left and right at the 
same time. In addition, regarding to the up and down 
direction, the scroll button 35B placed at the right side of 
the parameter setting window 35 is operated so as to 
scroll the graphic image of the parameter setting win- 
dow 35 in the direction of up and down. 

Here, to set the gain of the clip specified to each 
layer, a desired layer number is first clicked among from 
the layer numbers displayed at the left corner of the 
parameter setting window 35 to specify the layer of 
which parameter is set next. Then, a point of which 
parameter is changed is decided and the gain value to 
be set is decided, with viewing the content of the com- 
posite processing specified on the time line window 34. 
The position corresponding to the decided point and 
value is clicked at the parameter setting window 35 con- 
sisting the vertical axis being the gain value and the hor- 
izontal axis being time. Thereby, the gain value and the 
gain changing point corresponding to the clicked posi- 
tion are registered automatically. 

For example, as shown in Fig. 10, to set the gain of 
the material clip MC-003 specified to the layer L1 to 
100%, if the positions where the gain is 100% are 
clicked at the positions of the in-point and the out-point 
of the material clip MC-003, the gain of the material clip 
MC-003 from the in-point to the out-point are all set to 
1 00%. In the editing system 1 , since the set values are 
interpolated between the parameter setting points so as 
to be successive values and the interpolated values are 
automatically set If the same values are set at two 
parameter setting points in the above way, all values 
between two points are set to the same values. 

Further, regarding the material clip MC-002 set to 
the layer L2, to set the case where the gain to 59% at 
the in-point (the editing point EP2). the gain to 100% at 
the position a little before the point where the material 
clip MC-003 is piled up (the editing point EP3), and the 
gain to 0% at the ouH>oint (the editing point EP6), the 
corresponding points may be clicked respectively on the 
parameter setting window 35. Thus, the set gain values 
are automatically registered in the clip database. In 
addition, during the period between the editing point 
EP2 to the editing point EP3 and the period between the 
editing point EP3 to the editing point EP6, the gain val- 
ues are interpolated so as to be linear and successive 
values based on the values set at respective editing 
points, and the interpolated values are automatically 
set 

Similarly, regarding the material clip MC-003 set to 
the layer L3, to set the case where the gain to 1 00% at 
the in-point (the editing point EP4), the gain to 67% at 
the approximately center position of the material (the 
editing point EPS), and the gain to 51% at the out-point 
(the editing point EP7), the corresponding points may 
be clicked respectively on the parameter setting window 
35. Thus, the set gain values are automatically regis- 
tered in the clip database. In addition, also in this case, 



during the period between the editing point EP4 to the 
editing point EPS and the period between the editing 
point EPS to the editing point EP7. the gain values are 
interpolated so as to be linear and successive values 

5 based on the values set at respective editing points, and 
the interpolated values are automatically set. 

In this way, if the gain values are set as described 
above, the gain values are successively changed at 
respective timings. Therefore, the picture of such image 

1 o can be obtained that after the video data of the material 
clip MC-002 is gradually viewed on the video data of the 
material clip MC-003, the video data of the material clip 
MC-001 is further viewed on these video data, thereaf- 
ter, the video data of the material clip MC-002 and the 

is material clip MC-001 gradually become faint. 

In addition, in the parameter setting window 35, as 
shown in Fig. 10. the values of the set parameters are 
displayed correspondingly to the editing points as a 
graph having the horizontal axis being time and the ver- 

20 tical axis being gain values. Thereby, an operator looks 
the display and can visually understand at a glance the 
parameter, the layer, and the timing which have been 
set. 

The preview window 36 is an area for displaying the 
25 video data of the material clip or the resultant clip, when 
the preview button, the view button, the all preview but- 
ton, or the all view button described later is operated. 
The provision of this display area makes it possible to 
confirm the video image of the material clip or the result- 
30 ant clip produced as a result of edit, while edit works is 
being performed. 

TTie device control window 37 is an area for display- 
ing the command buttons for controlling the operation of 
the video disk recorder 5 in which the video data of clips 

35 are stored. As shown in Fig. 10, a reproduction button 
37A, a stop button 37B, and six skip buttons 37C to 37H 
are provided as command buttons. In this case, the 
reproduction button 37A is a command button for send- 
ing the reproduction command to the video disk 

40 recorder 5. The stop button is a command button for 
sending the reproduction stop command to the video 
disk recorder 5. The skip buttons 37C, 37D are com- 
mand buttons for sending to the video disk recorder 5 
the skip command for skipping the reproduction position 

45 to one frame forward or one frame backward. The skip 
buttons 37E, 37F are command buttons for sending to 
the video disk recorder 5 the skip command for skipping 
the reproduction position to one editing point forward or 
one editing point backward. The skip buttons 37G, 37H 

so are command buttons for sending to the video disk 
recorder 5 the skip command for skipping the reproduc- 
tion position to the head position or the end position of 
the video data. The provision of these command but- 
tons makes it possible to easily control the operation of 

55 the video disk recorder 5 while edit works is being per- 
formed. 

The edit content display window 38 is called co-time 
line, and an area for displaying the content of edit spec- 
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Hied on the time line window 34. In the time line window 
34, since all contents of edit can not be displayed alt 
together because of the restriction of the screen, the 
graphic image that the content of edit is reduced is dis- 
played on the edit content display window 38, so as to 
easily understand which content of edit is specified as a 
whole. For example, in the case where the content of 
edit such like that three material clips MC-003, MC-002 
and MC-001 described above are composed is speci- 
fied on the time line window 34, the graphic image such 
that three bar graphic images showing the clips speci- 
fied to respective layers are superimposed is displayed 
on the edit content display window 38. Therefore, an 
operator looks the display, and can entirely understand 
the contents of the edit specified, which is the compos- 
ite processing of three clips. 

In addition, in the edit content display window 38, 
also in the case where the resultant clip, which is dis- 
played on the library window 33 and the clip tree window 
31 and which has been already registered in the clip 
database, is selected, the graphic image showing the 
edit content of the resultant clip is displayed. Therefore, 
also in the case where the resultant clip displayed on 
the library window 33 and the clip tree window 31 is 
selected during the edition on the time line window 34, 
the contents of edit specified to the selected resultant 
clip can be easily obtained. 

Finally, the control command window 39 is an area 
for displaying the list of the control commands used in 
the editing system 1. As shown in Rg. 10, for example, 
the control commands to be displayed have an editor 
button (Editor), a composite button (Composite), a spe- 
cial effect button (S-Effect), a preview button (Preview), 
a view button (View), an all preview button (All Preview), 
and an all view button (All View), etc. 

The editor button, the composite button, and the 
special effect button are buttons for starting up the 
respective modules for edit. More specifically, the editor 
button is a button for starting up the edit module EM. 
The editor button is clicked to start up the edit module 
EM even if the composite module CM has been driven 
for instance. Further, the composite button is a button 
for starting up the composite module CM. The compos- 
ite button is clicked to start up the composite module 
CM even if the special effect module SM has been 
driven for instance. Further, the special effect button is a 
button for starting up the special effect module SM. The 
special effect button is clicked to start up the special 
effect module SM even if the edit module EM has been 
driven for instance. 

On the other hand, the preview button, the view but- 
ton, the all preview button, and the all view button are 
buttons for confirming the content of the material clip or 
the resultant clip. More specif ically, the preview button is 
a button used for displaying the video data of the 
selected clip on the preview picture display window 36. 
When the preview button is operated, since the edit con- 
tent specified is not executed, the displayed video data 



may be different from the final result (the video data of 
the final result is displayed when the edit content has 
been already executed and the video data correspond- 
ing to the edit content has been produced ). However, 

5 when the preview button is operated, the display is 
immediately started, and it is used in the case of check- 
ing the length of clip in the edit process. 

The view button is a button used for displaying the 
video data of the selected clip on the preview picture 

w display window 36. The view button is different from the 
preview button, and the specified edit content is exe- 
cuted. Thus, when the view button is operated, although 
it takes time to display, the video data after edit can be 
confirmed. 

is The alt preview button is a button used for display- 
ing the video data from the first clip to be edited to the 
last clip to be edited on the preview picture display win- 
dow 36 without selection of clip. Also in the alt preview 
button, the specified edit content is not executed same 

20 as that of the preview button. 

The all view button is a button used for executing 
the edit content specified to ail clips to be edited and for 
displaying the video data on the preview picture display 
window 36. The all view button is operated so that the 

25 specified edit content is executed and the video data of 
the last result can be confirmed. When the edit content 
is executed, the produced clip vide data is automatically 
stored in the video disk recorder 5 and registered in the 
clip database CDB. 

30 

(4-2) GUI when the special effect module is started up 

Next, in this paragraph, the GUI when the special 
effect module SM is started up will be explained. In the 
35 editing system 1 , when the special effect module SM is 
started up, the graphic display shown in Rg. 1 1 is dis- 
played as a GUI of the special effect module SM on the 
display 2B of the work station 2. 

As shown in Rg. 1 1 , when roughly divided, the GUI 
40 of the special effect module SM is composed of a menu 
window 30, a dip tree window 31 , an effect selection 
window 40, a library window 33, a time line window 41 , 
a parameter setting window 42, a preview screen dis- 
play window 36, a device control window 37, an edit 
45 content display window 38, and a control command win- 
dow 39. 

Note that among the windows displayed on the GUI 
of the special effect module, the menu window 30, the 
clip tree window 31, the Iforary window 33, the preview 

so screen display window 36, the device control window 
37, the edit content display window 38 and the control 
command window 39 are same as that of the composite 
module CM described above, so that the explanation 
will be omitted here. 

55 Rrst. the effect selection window 40 is an area for 
selecting the special effect performed on the video data 
of clip, and the command buttons of various special 
effects are Displayed thereon. The command buttons to 



14 



27 



EP 0 863 510 A1 



28 



be displayed are a three-dimensional button for specify- 
ing the three-dimensional transform, a trail button for 
specifying the trail processing which adds an afterim- 
age, a brick button for specifying the brick processing 
which puts the video image on the plane of a cube and 5 
rotates it, a shadow button for specifying the shadow 
processing which adds a shadow to the video data, a 
mix button for specifying the mix processing which 
mixes the video data, a light button for specifying the 
light processing which lights up an object from one 1 
direction to add the shadow, a crop button for specifying 
the crop processing which cuts out a predetermined 
area from the video data, and so on. 

In the effect selection window 40, to select a 
desired special effect, the editing point on which the ; 
special effect is performed is designated on the time line 
window 41 , and then the command button correspond- 
ing to the desired special effect is clicked so as to auto- 
matically specify the special effect. 

The time line window 41 is an area for placing the 
clip to be edited on the time axis to designate the con- 
tent of edit On the time line window 41 displayed in the 
special effect module SM, the contents relating to the 
special effect processing are displayed. The time line 
window 41 is divided into areas. When roughly divided 
successively from the top, the areas are a time code dis- 
play area (Time Code), an editing point display area 
(Edit Point), a preview extent display area (Preview), 
and a clip and special effect specifying area (L1 to L10). 

The time code display area is an area for displaying 
the time code at the editing point. The time code is a 
time code on the time line of the resultant clip produced 
based on the edit content designated on the time line 
window 41. 

The editing point display area is an area for indicat- 
ing a point set as an editing point by a triangle mark. For 
example, when the special effect processing shown in 
Fig. 4 and Fig. 8 is specified, the editing points EP1 to 
EP7 are indicated by using triangle marks. 

The preview extent display area is an area for indi- 
cating the extent of the video data displayed on the pre- 
view screen display window 36 when a preview button 
and a view button which are described above are oper- 
ated. In this example, the section between the editing 
point EP1 and the editing point EP7 (that is, the whole 
resultant clip FC-009) are set as the dsplay extent, and 
a bar showing the section is displayed. 

The clip and special effect specifying area is an 
area for specifying for each layer the special effect 
applied to the clip. In the editing system 1 , ten layers of 
the layer L1 to the layer L10 are prepared, so that the 
clips to be special-effect processed can be specified to 
respective layers. Note that the display extent of the clip 
and special effect specifying area is limited (as shown in 
the figure, it is for about two layers), and the layers Li to 
L10 can not be displayed all together. However, the 
scroll button 41 A displayed at the right side of the clip 
and special effect specifying area is operated so that 



the clip and special effect specifying area can be 
scrolled in the up and down direction. Therefore, a 
desired layer can be displayed. 

Each of the layers L1 to L10 is divided into areas 
which consists four special effect areas (E1 to E4), a 
video area (Video) for specifying the clip to which the 
special effect is applied and a key area (Key) for speci- 
fying the key processing performed on the specified clip. 
The special effect specifying area is an area for desig- 
0 nating the special effect applied to the clip registered in 
the video area. Four special effect specifying areas are 
provided for one layer, so that four special effects can be 
applied to one dip at the same time. For example, as 
shown in Fig. 11, if the mosaic processing is specified 
is as the special effect E1 , the crop processing is specified 
as the special effect E2, the three-dimensional trans- 
form is specified as the special effect E3 t and the trail 
processing is specified as the special effect E4, four 
special effects can be applied to the clip MC-004 speci- 
20 tied in the video area. 

To set the special effect in the special effect speci- 
fying area, the editing points are previously designated 
to specify the extent to which the special effect is 
applied, and a desired command button is clicked on the 
25 effect selection window 40. Then, the cell indicating the 
selected special effect is displayed. The cell is placed 
on the special effect specifying area, so as to set the 
special effect automatically. 

To set the clip in the video area, the dip displayed 
30 on the library window 33 is dicked first or the clip dis- 
played on the clip tree window 31 is dicked, so as to 
select the clip to be edited. Such processing is per- 
formed to display the cell of the selected dip. The cell is 
placed at a desired position of the video area, so that 
35 the clip is set to the video area. 

Further, to set the key processing in the key area, 
when the portion of "Key" of the key area is dicked. the 
effect selection window 40 is changed into the key win- 
dow 32 described above. A desired key button is clicked 
40 to select the key processing. Such processing is per- 
formed to display the cell indicating the selected key 
processing. The cell is placed at the key area, so that 
the key processing is automatically set 

In addition, when the resultant clip already placed 
45 and displayed at the video area is selected by double- 
clicking, the module of which the resultant clip is pro- 
duced (that is, the composite module CM, the special 
effect module SM, or the edit module EM) is started up, 
and the content of edit applied to the resultant clip is cfis- 
50 played on the time line window of the GUI of the corre- 
sponding module. 

The parameter setting window 42 is an area for set- 
ting parameters of special effect processing specified by 
an operator, in the parameter setting window 42, if the 
55 command button of the effect selection window 40 is 
dicked, a parameter setting screen relating to the 
dicked special effect is displayed. For example, if the 3D 
button is clicked on the effect selection window 40 to 



15 



29 



EP 0 863 510 A1 



30 



specify the three-dimensional transform, the parameter 
setting screen relating to the three-dimensional trans- 
form shown in Fig. 1 1 is displayed on the parameter set- 
ting window 42. 

As shown in Fig. 1 1 , the parameters in the three- 
dimensional transform are the position in the three- 
dimensional space (X, Y Z), the rotating direction in the 
three-dimensional space (X, Y, Z), the aspect ratio (Asp) 
indicating the ratio of length and breadth of image, the 
skew (Skew) which is parameter of the distortion, and 
the perspective value (Pers) representing the value of 
far and near. These values of parameters can be set to 
arbitrary values between the maximum setting extent 
MAX and the minimum setting extent MIN using a 
default value (= "0") as a standard value. 

The horizontal axis (i.e., time axis) of the parameter 
setting window 42 corresponds to that of the time line 
window 41 each other, and the change point of the 
parameters can be determined with referring to the con- 
tent of the special effect processing specified at the time 
line window 41 . In connection, regarding to the horizon- 
tal direction, that is the left and right direction, the scroll 
button 42A placed at the bottom side of the parameter 
setting window 42 is operated so as to scroll the graphic 
image on the parameter setting window 42 in the direc- 
tion of left and right At this time, since the horizontal 
axis of the time line window 41 corresponds to that of 
the parameter setting window 42 each other, the 
graphic image of the time line window 41 and the 
graphic image of the parameter setting window 42 are 
linked and scrolled in the direction of left and right at the 
same time. In addition, regarding to the up and down 
direction, the scroll button 42B placed at the right side of 
the parameter setting window 42 is operated so as to 
scroll the graphic image on the parameter setting win- 
dow 42 in the direction of up and down. 

Here, to actually set the parameters of the three- 
dimensional transform, a desired item is first clicked 
among from the items of parameters displayed at the 
left comer of the parameter setting window 42 to specify 
the item that parameter is set next. Then, a point of 
which parameter is changed is decided and the setting 
value is decided with viewing the content specified on 
the time line window 41 . The position corresponding to 
the decided point and the setting value is clicked on the 
parameter setting window 42 consisting the vertical axis 
being the parameter value and the horizontal axis being 
time. Thereby, the parameter value and the parameter 
changing point corresponding to the clicked position are 
registered automatically in the clip database CDB. 

For example, as shown in Fig. 1 1 , in the case where 
the position in the X-axis direction is gradually moved 
from the editing point EP4 to the minus direction, the 
desired values are successively clicked so as to register 
the values automatically. Similarly, in the case where 
the position in the Y-axis direction is gradually moved 
from the editing point EP6 to the plus cfirection, the 
desired values are successively clicked so as to register 



the values automatically. Similarly, in the case where 
the position in the Z-axis direction is gradually moved 
from the editing point EP2 to the plus direction, the 
desired values are successively clicked so as to register 

5 the values automatically. In addition, the sections 
between the points specified by an operator are interpo- 
lated successively and the values such that the video 
image is continuously moved are automatically set. 
Further, in the case of performing the rotation 

10 processing such that the video image is slowly rotated 
in the minus direction with the X-axis being centered in 
the range from the editing point EP2 to the editing point 
EP5, and the slowly rotated in the opposite direction 
after the editing point EP5 by turn, desired values are 

is clicked at the editing point EP5 and the editing point 
EP7 so as to register the values automatically. In addi- 
tion, also in this case, the section between the points 
specified by an operator are interpolated successively 
and the values such that the video image is corrtinu- 

20 ously rotated are automatically set. In connection, it can 
be arbitrarily decided by setting that the section is inter- 
polated linearly or interpolated with a spline curve. In 
this example, the rotation processing is set to be inter- 
polated with a spline curve, so that the values are set in 

25 accordance with a spline curve between the points 
specified by the operator. 

In this way. if desired values are set to the parame- 
ters of the special effect on the parameter setting win- 
dow 42, the values of parameters are registered in the 

30 clip database CDB, and the special effect is applied to 
the video data of the clip to be edited based on the reg- 
istered parameter values. In addition, in the parameter 
setting window 35, as shown in Fig. 1 1 , the values of the 
set parameters are displayed corresponding to the edit- 

35 ing points on a graph having the horizontal axis being 
time and the vertical axis being parameter values. 
Thereby, an operator looks the display and can visually 
understand at a glance the values, the parameters, and 
the timings which have been set. 

40 

(4-3) GUI when the edit module is started up 

Next, in this paragraph, the GUI when the edit mod- 
ule EM is started up is explained. In the editing system 

45 1 , the graphic display shown in Fig. 12 is displayed as a 
GUI of the edit module EM on the display 2B of the work 
station 2, when the edit module EM is started up. 

As shown in Fig. 12, when roughly divided, the GUI 
of the edit module EM is composed of a menu window 

50 30, a clip tree window 31 , an effect selection window 50, 
a library window 33, a time line window 51 . a parameter 
setting window 52, a preview screen display window 36, 
a device control window 37. an edit content display win- 
dow 38, and a control command window 39. 

55 Note that among the windows displayed on the GUI 
of the edit module EM, the menu window 30, the clip 
tree window 31 , the preview screen display window 36, 
the device control window 37, and the control command 
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window 39 are same as that of the composite module 
CM described above, so that the explanation is omitted 
here. 

First, the effect selection window 50 is an area for 
selecting the transition effect used in changing the video * 
data of clip specified as an object to be edited, and the 
command buttons of various transition effects are dis- 
played thereon. The command buttons to be displayed 
are a wipe button for specifying the wipe effect which 
changes an image by wiping the image being displayed 
at present with a new image, a slide button for specify- 
ing the slide effect which changes into a new image by 
sliding an old image like the Kamishibai (telling a story 
with picture cards), a split button for specifying the split 
effect which changes into a new image by splitting an 
old image to be slid, a squeeze button for specifying the 
squeeze processing which changes an image by 
spreading a new image on an old image, and a page 
turn button for specifying the page turn processing 
which changes an image by paging an old image, and 
so on. 

In the effect selection window 50, a scroll button 
50A of the left and right direction is displayed at the bot- 
tom position of the area, so as to scroll the displayed 
command button in the right and left direction. Similarly, 
a scroll button 50B of the up and down direction is dis- 
played at the right side position of the effect selection 
window 50, so as to scroll the displayed command but- 
ton in the up and down direction. 

In the effect selection window 50, to select a 
desired transition effect, the editing point on which the 
transition effect is performed is designated on the time 
line window 51, and then the command button corre- 
sponolng to the desired transition effect is clicked so as 
to automatically specify the transition effect. 

The library window 33 is an area for displaying the 
list of the material clips or the resultant clips registered 
in the clip database CDB. On the library window 33, as 
shown in Ftg. 1 0 and Fig. 1 1 , although only a title bar is 
displayed usually, the title bar is clicked to open a win- 
dow, so that the library window 33 is entirely displayed 
as shown in Fig. 12. 

As shown in Fig. 12, on the library window 33, dips 
are displayed with a card graphic display 33A. At this 
time, the card graphic display 33A is composed of a still 
picture display part 33B, an attribute display part 33C, 
and a clip name display part 33D. The still picture of the 
in-point or the out-point of the clip is displayed on the 
still picture display part 33B. Thereby, an operator can 
understand easily that which of video data is the clip 
produced from by viewing the screen displayed on the 
still picture display part 33B. 

The character of "FCT or "MC" showing the attribute 
of the clip is displayed on the attribute display part 33C. 
In this case. "FC" shows that the clip is the resultant clip 
produced as a result of the edit, and "MC* shows that 
the clip is the material clip only taken out from the 
source video data. In this way, the information showing 



the attribute is displayed so that the operator can easily 
understand whether the clip is the resultant clip or the 
material clip by viewing the display. The clip name 
added by the operator is displayed on the clip name dis- 

5 play part 33D. Note that the clip name has been regis- 
tered in the blip database CDB as a clip management 
data described later. 

Thus, in the library window 33, the clip which has 
been registered already in the clip database CDB is dis- 

10 played as a list, so that the clip to be edited is easily 
selected among from the clips already registered. 

In addition, a scroll button 33E is displayed at the 
right side position of the library window 33. The scroll 
button 33E is operated to scroll the library window 33 in 

75 the up and down direction, so that the all clips registered 
in the library window 33 can be displayed. Therefore, 
the clip which is not shown at present can be also 
selected. 

The time line window 51 is an area for placing the 
20 clips to be edited on the time axis to designate the con- 
tent of edit. On the time line window 51 displayed at the 
edit module EM, the content relating to the edit process- 
ing is displayed. The time line window 51 is divided into 
areas. When roughly divided successively from the top, 
25 the areas are a time code display area (Time Code), an 
editing point display area (Edit Point), a preview extent 
display area (Preview), a video and effect specifying 
area (V), and an audio specifying area (A). 

The time code display area is an area for displaying 
30 the time code at the editing point The time code is a 
time code on the time line of the resultant clip produced 
based on the edit content designated on the time line 
window 51 . 

The editing point display area is an area for indicat- 

35 ing points set as an editing point by triangle marks. For 
example, when the edit processing shown in Fig. 4 and 
Rg. 9 is specified, the editing points EP1 to EPS are 
indicated by using triangle marks. However, in Rg. 12, 
since the area and the vicinity on which the transition 

40 effect is applied are-only displayed on the time line win- 
dow 51, the editing points EP2 to EP4 are only dis- 
played. In addition, to display the editing point EP1 and 
the editing point EPS, as described later, the scroll but- 
ton of the left and right direction is operated on the 

45 parameter setting window 52, so that the graphic image 
in the time line setting window 52 is scrolled in the left 
and right direction to display the editing point EP1 or the 
editing point EPS. 

The preview extent display area is an area for indi- 

so eating the extent of the video data displayed on the pre- 
view screen display window 36 when a preview button 
and a view button which are described above are oper- 
ated. In this example, since the extent from the section 
between the editing point EP1 and the editing point EP2 

55 to the section between the editing point EP4 and the 
eaiting point EP5 are set as the display extent, a bar 
showing the extent is displayed. 

The video and effect specifying area is divided into 



17 



33 



EP 0 863 510 A1 



34 



areas. They are a first and second video area (Video- 
Li , Video-L2) for specifying the clip to be edit, and an 
effect area (Effect) for specifying the transition applied 
to the clip to be edited. 

To specify the clip to be edited in the first or second 
video area, a desired clip is clicked on the library win- 
dow 33 or the clip tree window 31 to display the cell 
showing the clip. The cell is placed in the first or second 
video area, so that the clip is set to the first or second 
video area and registered as a clip to be edited. For 
example, if the resultant clip FC-008 is clicked and 
placed at the first video area, and the resultant clip FC- 
009 is clicked and placed at the second video area, as 
shown in Fig. 12, the resultant clips FC-008 and FC-009 
are set to the first and second video area respectively. In 
addition, the video data set to the first video area 
becomes an old video data, and the video data set the 
second area becomes the video data newly changed. 

Similarly, to specify the transition effect in the effect 
area, a desired effect button is clicked on the effect 
selection window 50 to display the cell showing the 
effect. The cell is placed in the effect area, so that the 
effect is set to the effect applied to the clip to be edited. 
For example, if the wipe button is clicked on the effect 
selection window 50. the cell showing the wipe is dis- 
played. The cell is placed at the effect area, as shown in 
Fig. 12, the wipe processing is set as a processing of 
changing the resultant clip FC-008 and the resultant dip 
FC-009. 

The audio specifying area is an area for specifying 
the audio data output with the video data. In this case, it 
is divided into the first and second audio areas (Audio- 
1ch, Audio-2ch). In addition, to set the audio data in the 
first and second audio areas, similarly to the setting 
method in the video area, a desired clip is clicked and 
placed in the first or second audio area, the audio data 
of the dtp is set to the audio data to be output. In con- 
nection, the audio data set in the first audio area is out- 
put to the first channel of the stereo broadcasting, and 
the audio data set in the second audio area is output to 
the second channel of the stereo broadcasting. 

In addition, the resultant dip which has been placed 
in the first or second video area and already displayed is 
selected by double-clicking, the module which has pro- 
duced the clip, that is the composite module CM, the 
spedal effect module SM, or the edit module EM is 
started up and the content of the edit which has been 
applied to the dip is displayed on the time line window 
of the GUI of the corresponding module. 

The parameter setting window 52 is an area for set- 
ting parameters relating to the transition effect specified 
by the operator. In the parameter setting window 52, 
when the effect button of the effect selection window 50 
is clicked, the parameter setting screen relating to the 
dicked effect is displayed. For example, if the wipe but- 
ton is clicked on the effect selection window 50 to spec- 
ify the wipe processing, as shown in Fig. 12, the 
parameter setting screen relating to the wipe process- 



ing is displayed on the parameter setting window 52. 

Parameters in the wipe processing, as shown in 
Fig. 12, are the aspect ratio (Aspect) indicating the ratio 
of length and breadth of wipe pattern, the angle (Angle) 
5 prescribing the angle of wipe pattern, the speed 
(Speed) prescribing the speed of wipe pattern in chang- 
ing the image, the horizontal modulation (H Mod) pre- 
scribing the wave given in the horizontal direction of the 
wipe pattern edge, and the vertical modulation (H Mod) 
10 prescribing the wave given in the vertical direction of the 
wipe pattern edge. These parameter values can be set 
to arbitrary values between the maximum setting extent 
MAX to the minimum setting extent MIN based on the 
default value (= "0"). However, as the parameter of the 
is speed, the default value is set to the minimum setting 
extent MIN, and the changeable extent are from the 
default value to the maximum setting value MAX. 

The horizontal axis (that is, time axis) of the param- 
eter setting window 52 corresponds to that of the time 
20 line window 51 each other, and the change point of the 
parameter can be decided, with viewing the content of 
the edit processing specified on the time line window 
51. In connection, with regard to the vertical direction, 
that is the left and right direction, the scroll button 52A 
25 positioned at the bottom of the parameter setting win- 
dow 52 is operated so as to scroll the graphic image in 
the parameter setting window 52 in the direction of left 
and right. At this time, the horizontal axis of the time line 
window 51 corresponds to that of the parameter setting 
30 window 52 each other, the graphic image of the time line 
window 51 and the graphic image of the parameter set- 
ting window 52 are linked and scrolled in the left and 
right direction at the same time. In addition, with regard 
to the up and down direction, the scroll button 52B posi- 
35 tioned at the right side of the parameter setting window 
52 is operated so as to scroll the graphic image in the 
parameter setting window 52 in the direction of up and 
down. 

Here, to actually set the parameters of the wipe 

40 processing, a desired item is first dicked among from 
the items of parameter displayed at the left corner of the 
parameter setting window 52 to specify the item of 
which parameter is set next. Then, a point of where the 
parameter is changed is dedded with viewing the con- 

45 tent specified at the time line window 51 , and the setting 
value is decided. The position corresponding to the 
decided point and the setting value is dicked on the 
parameter setting window 52 consisting the vertical axis 
being parameter values and the horizontal axis being 

so time Thereby, the parameter value and the parameter 
changing point corresponding to the clicked position are 
registered automatically in the dip database CDB. 

For example, as shown in Fig. 12, in the case where 
the aspect ratio of the wipe pattern is gradually 

55 increased from the editing point EP2 to the editing point 
EP4, the desired values are successively clicked so as 
to register the values automatically. In addition, the sec- 
tion between the points specified by an operator are 
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interpolated successively and the values such that the 
aspect ratio of the wipe pattern is continuously changed 
are automatically registered. 

Similarly, *rt is desired that the angle of the wipe pat- 
tern is gradually increased from the editing point EP2 to s 
the editing point EP3, and the wipe pattern is gradually 
inclined from the editing point EP3 to the editing point 
EP4, the desired values are successively clicked so as 
to register the values automatically. Also in this case, 
the section between points specified by the operator is 1 
interpolated, and the values such that the wipe pattern 
changes continuously is registered automatically. In 
connection, it can be arbitrarily decided whether the 
section is interpolated linearly or interpolated with a 
spline curve. In this example, the angle is set to be inter- i 
polated with a spline curve, so that the section specif ied 
by the operator is set to the value which is along the 
spline curve. 

Further, it is desired that the speed of the wipe pat- 
tern is fixed from the editing point EP2 to the editing i 
point EP3, and gradually accelerated from the editing 
point EP3 to the editing point EP4, desired values are 
successively clicked so as to register the values auto- 
matically In addition, also in this case, the section 
between points specified by an operator is interpolated, 
and the value such that the speed of the wipe pattern is 
continuously changed is registered automatically. 

Thus, in the parameter setting window 52, when a 
desired value is set to the parameter of the transition 
effect, the value of parameter is registered in the clip 
database CDM, and the transition effect is applied to the 
video data of the clip to be edited based on the regis- 
tered value of parameter. In addition, in the parameter 
setting window 52, as shown in Fig. 12, the set value of 
parameters are displayed corresponding to the editing 
points on a graph having the horizontal axis being time 
and the vertical axis being parameter values. Thereby, 
an operator looks the display and can visually under- 
stand at a glance the parameters, the values, and the 
timings which have been set. 

The edit content display window 38 is an area for 
displaying with the graphic image the content of edit 
specified on the time line window 51. As described 
above in the time line window 51 , in the case of specify- 
ing the edit processing such that two clips FC-008, FC- 
009 are switched by the wipe processing, the graphic 
image such that the graphic image showing the wipe 
processing is sandwiched between bar graphic images 
showing the respective clips unevenly is displayed. 
Thereby, an operator looks this display so as to easily 
understand which edit content is indicated as a whole. 
Specially, as shown in Fig. 12, when only a part of area 
is displayed on the time line window 51 , although the 
content of entire processing is not easy to understand, 
looking at the edit content display window 38, the con- 
tent of entire processing can be easily understood. 



(5) Method for managing the clip management data in 
the dip database 

In the editing system 1 according to this invention, 
the material clips and resultant clips produced by editing 
the material clips are all registered in the clip database 
CDB. The data registered in the clip database CDB, 
when roughly divided, are the clip video data of the 
material clip and the resultant clip, and the clip manage- 

o ment data for managing the clip video data. In this par- 
agraph, the method for managing the clip management 
data is explained. 

Fig. 13 shows a database for the clip management 
data generated in the dip data base CDB (mainly, RAM 

is 21 B), when the edit processing shown in Figs. 7, 8, and 
9 are instructed. The database for managing the clip 
management data, as shown in Fig. 13, is composed of 
dip ID code, clip name, attribute, pointer to image data, 
duration, parent link ID code, child link ID code, ena- 

20 ble/disable flag, and work data, when roughly divided. 

The clip ID code is an identification number of the 
serial number automatically added to the clip in the 
order of being registered as a dip. Therefore, the regis- 
tered clip can be identified on the basis of the clip ID 

25 code. 

The attribute of dip is data for identifying whether 
the clip is only a material dip or the clip is a resultant clip 
produced by editing a material clip. If it is a material dip, 
the code "M" is registered as the attribute of the clip. If it 
30 is a resultant clip, the code "F" is registered. 

The dip name is a name for identifying the dip, 
which is added to the clip. In this example, when the clip 
ID code is "001" and the attrfoute of the dip is "M", the 
name "MC-001" is automatically added as a clip name. 
35 In addition, an arbitrary name can be added as a clip 
name adapting the user's taste. In connection, the clip 
name displayed at the dip name display part 33D of the 
library window 33 is this clip name. 

The pointer to the image data is composed of eight- 
40 byte data, and is a pointer showing the head address of 
the dip video data recorded in the video disk recorder 5. 
In the editing system 1 , the dtp video data has been 
stored in the video disk recorder 5 having a plurality of 
hard disk, and the pointer to the image data indicates 
45 the logical address of the hard disk array. 

The duration is a time code showing the reproduc- 
tion period of the clip video data of the dip. That is, it is 
a time code showing the time from the start to the end 
of the dip video data. 
so The parent link ID code is the clip ID code of the dip 
which is linked thereto as an upper clip. For example, 
since the material dip MC-001 of which the dip ID code 
is "001" is linked to the resultant clip FC-008 of which 
the clip ID code is "008", the dip ID code "008" of the 
55 resultant dip FC-008 has been registered as a parent 
link ID code. 

In addition, for the clip which does not have the 
upper clip because it is the uppermost dip, "000" is reg- 
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istered as a parent link ID code. For example, the result- 
ant clip FC-010 does not have the upper clip, thereby 
"000" has been registered as a parent link ID code. In 
this way, if the parent link ID code is "000", it can be eas- 
ily understand that it is the uppermost clip. 5 

The child link ID code is the dip ID code of the clip 
which is linked thereto as a lower clip. For example, the 
material clips MC-001, MVC-002, and MC-003 are 
linked as a lower clip to the resultant clip FC-008 of 
which the clip ID code is "008". At this time, the material 10 
clip MC-001 is specified as the third layer L3, the mate- 
rial clip MC-002 is specified as the second layer L2, and 
the material clip MC-003 is specified as the first layer 
L1. Therefore, "003" has been registered as the clip ID 
code of the clip which is the lower clip of the resultant 15 
clip FC-008 and is specified to the first layer L1, "002" 
has been registered as the clip ID code of the clip which 
is the lower clip of the resultant clip FC-008 and is spec- 
ified to the second layer L2, and "001" has been regis- 
tered as the clip ID code of the clip which is the lower 20 
clip of the resultant clip FC-008 and is specified to the 
third layer L3. In addition, the lower clip being linked to 
the lower hierarchy is managed corresponding to the 
layer, so as to easily understand that which of lower 
clips is specified to which of layers. 25 

In addition, in the clip having no lower clip, no data 
is registered as a child link ID code. For example, the 
material dip MC-001 is only a material dip and has no 
lower clip, thereby the child link ID code is a blank. 

The enables/disable flag is a flag showing whether 30 
the dip is enable or disable. When the clip is enable, the 
code "E" is registered, and when the clip is disable, the 
code "D" is registered. In connection, if the content of 
edit specified has been executed and the clip video data 
has been produced as a result of edit, the enable flag is 35 
registered. If the content of edit has not been executed 
and the dip video data has not been produced, or if 
although the content of edit has been once executed, 
thereafter the content of edit and the clip being material 
is changed so that the clip video data does not corre- 4C 
spond to the actual edit content, the disable flag is reg- 
istered- In addition, the enable/disable flag is provided 
as a clip management data, so that when the database 
for clip management data is referred, it can be easily 
understood whether the dip is enable or disable. 4i 

The work data is data showing the edit content 
spedfied to the clip. Therefore, some work data has 
been registered in the resultant clips FC-008, FC-009, 
and FC-010 produced by edit. However, no work data 
has been registered in the material dip MC-001 to the a 
material clip MC-007 which has not been produced by 
edit. 

As shown in Rg. 1 3, when roughly divided, the work 
data is dassified to a module ID code, an editing point 
data, and an image processing data. The module ID 5 
code is an identification number indicating the module 
used in the edit work for producing the resultant dqp. In 
this case, the code "C is registered when the compos- 



ite module CM is used, the code "S" is registered when 
the special effect module SM is used, and the code "E" 
is registered when the edit module EM is used. 

Also, the editing point data is data composed of all 
editing points specified to the resultant clip and time 
codes corresponding to the editing points. 

Further/the image processing data is composed of 
the composite data, the special effect data, and the edit 
data. The composite data is data being parameter val- 
ues specified in the composite processing, the spedal 
effect data is data being parameter values specified in 
the special effect processing, and the edit data is data 
being parameter values specified in the edit processing. 

In addition, when the content of edit processing is 
modified, the contents of these clip management data 
are re-written at any time based on the new edit content. 
However, the old clip management data is not elimi- 
nated, and another dip ID code and the clip name are 
added to be stored as a backup data. For example, 
when the content of the spedal effect processing for the 
resultant dip FC-009 is modified, as shown in Fig. 14, 
the dip management data before modification is stored 
as a backup data. 

More specifically, when the new special effect 
processing is instructed to the resultant clip FC-009, the 
editing point data after modification and the special 
effect data after modification are produced based on the 
content of the new special effect processing, and they 
are registered as a work data in the place of the dip 
before modification (i.e., the place that the clip ID data is 
"009") respectively. On the other hand, to the editing 
point data before modification and the spedal effect 
data before modification which have been registered as 
a work data before the new special effect processing is 
instructed, the new clip ID code "009BK1" and the clip 
name "FC-009BK1 " are assigned. Then, on the basis of 
these identification information, they are registered in 
the other area of the database as a clip management 
data for backup. However, in the clip management data 
registered as backup, the enable/disable flag is 
changed into the code "D" indicating the cfisable. 

In this way, the dip management data before modi- 
fication is remained as a backup, so that even if you do 
not like the resultant clip FC-009 after modification, you 
can easily return to the resultant clip FC-009BK1 before 
modification based on the clip management data before 
modification which is remained as a backup. 

Here, the editing point data, composite data, spe- 
cial effect data, and edit data which are registered as 
i work data descrtoed above are concretely explained 
hereinafter. First, referring to Figs. 15 to 17, the editing 
point data is explained. 

When the composite processing shown in Fig. 7 is 
instructed to the resultant dip FC-008. the editing point 
» shown in Fig. 15 is registered. As shown in Fig. 15, the 
editing point data is data for specifying that which part of 
the lower dips is used to the clip video data of the upper 
dip. and is composed of the time code of in-point indi- 
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eating the starting position of the lower clip and the time 
code of out-point indicating the end position. 

As shown in Fig. 7, the time code of the in-point of 
the material clip MC-003 specified as the first layer L1 is 
"00:00:31 :02" on the time line t3, and the position of the i 
in-point corresponds to the time code "00:00:00:00" on 
the time line t8 of the resultant clip FC-008. Therefore, 
in the editing point data, as shown in Rg. 15, the time 
code "00:00:00:00" of the resultant clip FC-008 and the 
time code "00:00:31:02" of the in-point of the material 
clip MC-003 are correspondingly registered at the edit- 
ing point EP1 . Further, as shown in Fig. 7, the time code 
of the out-point of the material clip MC-003 specified as 
the first layer L1 is "00:05:18:02" on the time line t3. and 
the position of the out-point corresponds to the time 
code "00:04:47:00" on the time line t8 of the resultant 
clip FC-008. Therefore, in the editing point data, as 
shown in Rg. 15, the time code "00:04:47:00" of the 
resultant clip FC-008 and the time code "00:05:1 8:02" of 
the out-point of the material clip MC-003 are corre- 
spondingly registered at the editing point EP8. The edit- 
ing point of the material clip MC-003 specified as the 
first layer L1 is decided by the time codes of the in-point 
and the out-point. 

Similarly, as shown in Rg. 15, the time codes 
"00:00:51 :00" and "00:03:0420" of the in-point and out- 
point of the material clip FC-002 specified as the sec- 
ond layer L2 are also registered correspondingly to the 
time codes of the resultant dip FC-008. Also, the time 
codes ^OiOI^O^" and "00:02:45:48" of the in-point 
and out-point of the material clip FC-001 specified as 
the third layer L3 are also registered correspondingly to 
the time codes of the resultant clip FC-008. 

When the special effect processing shown in Rg. 8 
is instructed to the resultant clip FC-009, the editing 
point data shown in Rg. 16 is registered. As shown in 
Rg. 16, also in the case of special effect processing, in 
the editing point data, the time code of the lower clip and 
the time code of the upper clip are registered corre- 
spondingly. More specialty, as shown in Rg. 1 6, the time 
codes of the in-point and the out-point of the material 
clip MC-004 "00:10:12:00" and "00:12:18:00" are regis- 
tered with corresponding to the time code of the result- 
ant clip FC-009. 

Further, when the edit processing shown in Rg. 9 is 
instructed to the resultant clip FC-010, the editing point 
data shown in Rg. 17 is registered. As shown in Rg. 1 7, 
also in the case of edit processing, in the editing point 
data, the time code of the lower clip and the time code 
of the upper clip are registered correspondingly. More 
specially, as shown in Fig. 17, the time codes of the in- 
point and the out-point of the resultant clip FC-008 
specified as the first layer L1 "00:01:01.20" and 
"00:04:43:00" are registered with corresponding to the 
time code of the resultant clip FC-010, and as shown in 
Rg. 17, the time codes of the in-point and the out-point 
of the resultant clip FC-009 specified as the second 
layer L2 "00:00:00:50" and "00:02:06:00" are registered 



with corresponding to the time code of the resultant clip 
FC-010, 

Next, referring to Fig. 18, the composite data is 
explained. The composite data is data fob showing the 
s composite ratio (gain) when the video data of the clip 
specified to each layer is composed, and takes a value 
from "0" to "100". In addition, if the composite data is 
"0", this means that the video data to be composed is 
composed with the ratio of 0%, and the video data at a 
10 lower layer is completely viewed transparently in this 
case. If the value of the composite data is "50", this 
means that the video data to be composed is composed 
with the ratio of 50%, and a half of the video data of the 
lower layer is viewed transparently. If the value of the 
15 composite data is "1 00", this means that the video data 
to be composed is composed with the ratio of 100%, 
and the video data of the lower layer is completely hid- 
den and not viewed. 

Here, the concrete example is shown in Fig. 18. Rg. 
20 18 shows a database of the composite data produced 
when the composite data (gain) is specified by using the 
parameter setting window 35 shown in Fig. 10. 

When the gain "100" is specified to the material dip 
MC-003 specified to the first layer L1 at a position of the 
25 editing point EP1 and a position of the editing point EP8, 
as shown in Rg. 18, the gain "100" is registered in the 
column corresponding to the editing point EP1 and the 
editing point EP8. Further, since the section between 
the editing point EP1 and the editing point EP8 is line- 
30 arly interpolated based on the value using the editing 
points EP1 and EP8 as key points, the gain "100" is 
automatically registered (in the figure, "--" shows that 
the interpolated value is registered). 

Also, when the gain "59" is specified to the material 
35 clip MC-002 specified to the second layer L2 at a posi- 
tion of the editing point EP2, the gain "100" is specified 
at a position of the editing point EP3, and the gain "0" is 
specified at a position of the editing point EP6 t as 
shown in Rg. 18, the gain "59", "100", and "0" are 
40 respectively and successively registered in the columns 
corresponding to the editing points EP2, EP3, and EP6. 
Also in this case, since the section between the editing 
point EP2 and the editing point EP3 and the section 
between the editing point EP3 and the editing point EP6 
45 are linearly interpolated based on the values using the 
editing points EP2, EP3, and EP6 as key points, the 
gain values which continue linearly are automatically 
registered. 

Also, when the gain "100" is specified to the mate- 
so rial clip MC-001 specified to the third layer L3 at a posi- 
tion of the editing point EP4, the gain "67" is specified at 
a position of the editing point EPS and the gain "51" is 
specified at a position of the editing point EP7, as 
shown in Rg. 18, the gain "100". "67". and "51" are 
55 respectively and successively registered in the columns 
corresponding to the editing points EP4. EPS, and EP7. 
Also in this case, since the section between the editing 
point EP4 and the editing point EPS and the section 
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between the editing point EPS and the editing point EP7 
are linearly interpolated based on the values using the 
editing points EP4, EPS, and EP7 as key points, the 
gain values which continue linearly are automatically 
registered. 

Thus, the composite data described above are reg- 
istered to execute the edit processing, so that the values 
of the composite data can be changed at a timing of 
each editing point at any time. As a result, the video 
image such that the video image of the material clip 
MC-002 specified to the layer 12 is gradually appeared 
on the video image of the material clip MC-003 speci- 
fied as the layer L1 from the point in time of the editing 
point EP2, and then after the editing point EP3, the 
video image of the material clip MC-002 becomes faint 
gradually, and at the point in time of the editing point 
EP4, the video image of the material clip MC-001 spec- 
ified as the layer L3 is appeared, thereafter, it becomes 
faint gradually, can be obtained. 

Next referring to Fig. 19, the special effect data is 
explained. The special effect data is basically com- 
posed of an effect ID data showing the type of the spe- 
cial effect processing applied to the clip to be edited, 
each parameter value of the specified special effect 
processing, and period that the special effect process- 
ing is performed. 

Here, the concrete example of the special effect 
processing shows in Fig. 19. Fig. 19 shows a database 
of the special effect data relating to the three-dimen- 
sional transform shown in Fig. 8 and a database of the 
special effect data produced when the parameter is set 
by using the parameter setting window 42 shown in Fig. 
11. 

In Rg. 19, "1025" registered as the effect ID data is 
an effect identification number assigned to the three- 
dimensional transform, and it can be known that the 
three-dimensional transform is specified as a special 
effect processing by the effect identification number 
"1025". Also, "Loc X". "Loc Y", and "Loc Z" represent the 
position (X, Y, Z) being parameters of the three-dimen- 
sional transform. "Rot X", "Rot Y", and "Rot Z" represent 
the rotation direction (X. Y, Z) being parameters of the 
three-dimensional transform. "Asp" represents the 
aspect ratio being parameter of the three-dimensional 
transform. "Skew" represents the skew being parameter 
of the three-dimensional transform. "Pers" represents 
the perspective value being parameter of the three- 
dimensional transform. As shown in Fig. 19, these 
parameters are specified from the editing point EP2 to 
the editing point EP7. Thereby, it can be easily under- 
stood that the editing point EP2 is the starting point and 
the editing point EP7 is the end point, as to the period 
where the three-dimensional transform is specified. In 
addition, the concrete values of the starting point and 
the end point of the three-dimensional transform, that 
are the time codes, are easily obtained by referring to 
the editing point data of Fig. 16 explained above. 

Here, in the parameter setting window 42 shown in 



Fig. 1 1 , when the coordinate values "0", "0", "-1 .6", and 
"-1.6" are respectively specified to the parameter "Loc 
X" at the editing points EP2, EP4, EP6, and EP7, as 
shown in Rg. 19, the coordinate values "0", "0", "-1 .6", 
s and "-1.6" are registered in the columns corresponding 
to the editing points EP2. EP4, EP6, and EP7. In this 
case, the sections between the editing point EP2 and 
the editing point EP4, between the editing point EP4 
and the editing point EP6, between the editing point 
10 EP6 and the editing point EP7, are linearly interpolated 
based on the values using the editing points EP2, EP4, 
EP6. and EP7 as key points, and the coordinate values 
which continue linearly are automatically registered. 
Similarly, when the coordinate values "0", "0", and 
is "+2" are respectively specified to the parameter "Loc Y" 
at the editing points EP2, EP6, and EP7, the corre- 
sponding coordinate values are registered in the col- 
umns corresponding to the editing points EP2, EP6, and 
EP7. When the coordinate values "0", "+2.2", and "+2.2" 
20 are respectively specified to the parameter "Loc Z" at 
the editing points EP2, EP6. and EP7, the correspond- 
ing coordinate values are registered in the columns cor- 
responding to the editing points EP2, EP6, and EP7. 
Further, when the rotation angles "0". "-180", and "- 
25 1 02" are respectively specified to the parameter " Rot X" 
at the editing points EP2, EPS, and EP7, the corre- 
sponding rotation angles are registered in the columns 
corresponding to the editing points EP2, EPS. and EP7. 
In addition, since the interpolation with a spline curve is 
30 set in this case, the values which continue along a 
spline curve are automatically registered between the 
editing point EP2 and the editing point EPS and 
between the editing point EPS and the editing point 
EP7. Moreover, regarding to the parameters "Rot Y", 
35 "Rot Z", "Asp", "Skew", and "Pers" which are not speci- 
fied, "0" is registered automatically as a default value. 

In this way, when the parameters relating to the 
three-dimensional transform are registered to execute 
the edit work, the values of parameters are changed at 
40 a timing of each editing point, and at the same time, 
changed into the interpolated values between respec- 
tive editing points, As a result, the video image which 
moves in the three-dimensional space with rotating 
using the X-axis as a shaft can be obtained. 
45 Next, referring to Rg. 20, the edit data is explained. 
The edit data is basically composed of an effect ID data 
showing the type of the transition effect applied to the 
dip to be edited, each parameter value of the specif ied 
transition effect and period that the transition effect is 
so performed. 

Here, the concrete example of the edit data shows 
in Fig. 20. Fig. 20 shows a database of the edit data pro- 
duced when the wipe processing shown in Rg. 9 is 
specified as a transition effect and when the parameter 
55 is set by using the parameter setting window 52 shown 
in Rg. 12. 

In Rg. 20, "0001" registered as the effect ID data is 
an effect identification number assigned to the wipe 
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processing that the image of the first video data is 
changed into the image of the second video data in the 
direction from the left side to the right side of the screen, 
and the effect identification number "0001" means that 
the wipe processing is specified as a transition effect > 

In addition, when the effect identification number 
"1300" is registered as an effect ID data, it means that 
the wipe processing is specified such that the image of 
the first video data is changed into the image of the sec- 
ond video data in the direction from the both sides of the 
screen to the center. When the effect identification 
number "2123" is registered as an effect ID data, it 
means that the page turn processing is specified such 
that the image of the first video data is changed as if a 
page is turned. 

Further, "Aspect" is a parameter indicating the ratio 
of length and breadth of wipe pattern. "Angle" is a 
parameter indicating the angle of wipe pattern, "Speed" 
is a parameter indicating the speed to change, and "H- 
Mod" and "V-Mod" are parameters indicating the wave 
of the wipe pattern respectively. As shown in Fig. 20, 
these parameters are specified from the editing point 
EP2 to the editing point EP4, thereby, it can be easily 
obtained that the editing point EP2 is the start point and 
the editing point EP4 is the end point as a period that 
the wipe processing is specified. In addition, the con- 
crete values of the start point and the end point of the 
wipe processing, that are time codes, can be easily 
obtained by referring to the editing point data of Fig. 17 
explained above. 

Here, when the values "0" and "+25" are respec- 
tively specified to the parameter "Aspect" at the editing 
points EP2 and EP4, as shown in Fig. 20, the corre- 
sponding values are registered in the columns corre- 
sponding to the editing points EP2 and EP4. In this 
case, the section between the editing point EP2 and the 
editing point EP4 is linearly interpolated based on the 
values using the editing point EP2 and the editing point 
EP4 as key points, and the values which continue line- 
arly are registered automatically. 

Also, when the values "20", "20", and "100" are 
respectively specified to the parameter "Speed" at the 
editing points EP2, EP3, and EP4, the corresponding 
values are registered in the columns corresponding to 
the editing points EP2, EP3, and EP4. Also in this case, 
the section between the editing point EP2 and the edit- 
ing point EP3 and the section between the editing point 
EP3 and the editing point EP4 are linearly interpolated 
based on the values using the editing points EP2, EP3. 
and EP4 as key points, and the values which continue 
linearly are registered automatically. 

While, when the values "0". "+180\ and "-180" are 
respectively specified to the parameter "Angle" at the 
editing points EP2, EP3. and EP4, the corresponding 
values are registered in the columns corresponding to 
the editing points EP2. EP3, and EP4. Since the inter- 
polation with a spline curve is set in this case, the values 
which continue along a spline curve are automatically 



registered between the editing point EP2 and the editing 
point EP3 and between the editing point EP3 and the 
editing point EP4. Moreover, regarding to the parame- 
ters "H-Mod" and "V-Mod" which are not specified, "0" is 
5 registered automatically as a default value. 

In this way, when the parameters relating to the 
wipe processing are registered to execute the edition 
work, the values of parameters are changed at a timing 
of the editing point, and at the same time, changed into 
io the interpolated values between respective editing 
points. As a result, the video image of the transition 
effect that the shape, angle, and speed of wipe pattern 
are changed successively can be obtained. 

is (6) Procedures in the editing system 

Next, in this paragraph, the operation procedure of 
each processing in the editing system 1 will be 
explained using flowcharts. Note that the contents of the 
20 operation procedures explained hereinafter are all per- 
formed by the operation of a CPU 21 based on the 
application program. 

When the editing system 1 is started up with a pre- 
determined method, the CPU 21 initially starts up the 
25 control module CNTM at step SP1 shown in Fig. 21 , and 
displays a top menu on the display 2B of the work sta- 
tion 2 at next step SP2. 

At next step SP3, the CPU 21 determines whether 
or not any item of menu is selected on the top menu. As 
30 a result, when the item of menu is selected, the item of 
menu is determined in following steps SP4 to SP7. 

As the result of the determination of step SP4, 
when the start-up command of the edit module EM is 
selected, the CPU 21 proceeds to step SP8 to perform 
35 the start-up processing of the edit module EM. As the 
result of the determination of step SP5. when the start- 
up command of the composite module CM is selected, 
the CPU 21 proceeds to step SP9 to perform the start- 
up processing of the composite module CM. As the 
40 result of the determination of step SP6, when the start- 
up command of the special-effect module SM is 
selected, the CPU 21 proceeds to step SP10 to perform 
the start-up processing of the special-effect module SM. 
While, as the result of the determination of step 
45 SP7, when the command for opening a file of the result- 
ant clip already registered is selected, the CPU 21 iden- 
tifies the module used in the selected resultant clip at 
the next step SP11 and starts up the identified module 
(that is, the edit module EM, the composite module CM, 
so or the special effect module SM) at next step SP12. In 
addition, at step SP1 1 . the CPU 21 refers the work data 
registered in the clip database CDB. so as to identify the 
module of the resultant clip selected. 

Here. Fig. 22 concretely shows the start-up 
55 processing of the edit module EM at step SP8. When 
the edit module EM is instructed to start tip. the CPU 21 
first displays the GUI of the edit module EM on the dis- 
play 2B of the work station 2 at step SP21 entering from 
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step SP20. At next step SP22, the CPU 21 determines 
whether or not the start-up of the edit module EM is 
instructed through the above step SP12. When the 
start-up of the edit module EM is instructed through step 
SP12, the CPU 21 proceeds to step SP23 to read out 5 
the content of edit processing of the specified resultant 
clip based on the clip management data registered in 
the clip database CDB, and displays the content of the 
edit processing on the time line window 51 of the GUI 
for edit module described above. 10 

On the other hand, as the result of the determina- 
tion of step SP22, when the start-up through step SP12 
is not instructed but the newly start-up is instructed, the 
CPU 21 proceeds to step SP24 to prepare the registra- 
tion of the clip management data for a newly edit is 
processing. More specifically, the area for registering 
the clip management data is secured on the clip data- 
base CDB in order to provide the content of the edit 
processing newly instructed. After the processing of 
step SP23 or step SP24 is performed, the CPU 21 pro- 20 
ceeds to step 25 to perform the actual edit processing. 

Further, Fig. 23 concretely shows the start-up 
processing of the composite module CM at step SP9. 
When the composite module CM is instructed to start 
up, the CPU 21 first displays the GUI of the composite 25 
module CM on the display 2B of the work station 2 at 
step SP31 entering from step SP30. At next step SP32, 
the CPU 21 determines whether or not the start-up of 
the composite module CM is instructed through the 
above step SP12. When the start-up of the composite 30 
module CM is instructed through step SP12, the CPU 
21 proceeds to step SP33 to read out the content of 
composite processing of the specified resultant clip 
based on the clip management data registered in the 
clip database CDB, and displays the content of the com- 35 
posite processing on the time line window 34 of the GUI 
for composite module described above. 

On the other hand, as the result of the determina- 
tion of step SP32, when the start-up through step SP12 
is not instructed but the newly start-up is instructed, the 40 
CPU 21 proceeds to step SP34 to prepare the registra- 
tion of the clip management data for a newly composite 
processing. More specifically, the area for registering 
the clip management data is secured on the clip data- 
base CDB in order to provide the content of the com- 45 
posite processing newly instructed. After the processing 
of step SP33 or step SP34 is performed, the CPU 21 
proceeds to step 35 to perform the actual composite 
processing. 

Further. Fig. 24 concretely shows the start-up so 
processing of the special effect module SM at step 
SP10. When the special effect module SM is instructed 
to start up, the CPU 21 first displays the GUI of the spe- 
cial effect module SM on the display 2B of the work sta- 
tion 2 at step SP41 entering from step SP40. At next ss 
step SP42, the CPU 21 determines whether or not the 
start-up of the special effect module SM is instructed 
through the above step SP12. When the start-up of the 



special effect module SM is instructed through step 
SP12, the CPU 21 proceeds to step SP43 to read out 
the content of special-effect processing of the specified 
resultant clip based on the clip management data regis- 
tered in the clip database CDB, and displays the content 
of the special effect processing on the time line window 
41 of the GUI for special effect module described above. 

On the other hand, as the result of the determina- 
tion of step SP42, when the start-up through step SP12 
is not instructed but the newly start-up is instructed, the 
CPU 21 proceeds to step SP44 to prepare the registra- 
tion of the clip management data for a newly special 
effect processing. More specifically, the area for regis- 
tering the clip management data is secured on the clip 
database CDB in order to provide the content of the 
special effect processing newly instructed. After the 
processing of step SP43 or step SP44 is performed, the 
CPU 21 proceeds to step 45 to perform the actual spe- 
cial effect processing. 

Here, the details of the edit processing at the step 
SP25 of Fig. 22 are illustrated in Fig. 25. Note that the 
figure is omitted, but the composite processing at step 
SP35 of Fig. 23 and the special effect processing at 
step SP45 of Rg. 24 are mostly same as that of the edit 
processing of Rg. 25. The difference is only that the 
content of the edit processing is changed into that of the 
composite processing or the special effect processing. 

As shown in Rg. 25, the CPU 21 first determines 
whether or not an input for instructing the edit process- 
ing is supplied at step SP51 entering from step SP50 
(e.g., determines whether or not the operation using the 
time line window 51 or the operation using the parame- 
ter setting window 52 exists). As a result, when the input 
is supplied, the CPU 21 proceeds to step S52, so that 
edit data corresponding to the input is produced to suit- 
ably write it in the clip database CDB as a clip manage- 
ment data, and the enable/disable flag of the resultant 
dip is set to disable. If the input is to read out the result- 
ant clip already registered and modify the content 
thereof, the CPU 21 dose not only overwrite, but also 
assigns another code to the dip management data 
before modification and maintains it in the other area. 
Thus, the dip management data before modification 
can be read later. 

When the processing of step SP52 is completed, 
the CPU 21 proceeds to next step SP53. At step SP53, 
the CPU 21 refers the parent link ID code of the dip 
management data, so as to determine whether or not 
the upper dip of the dip management data exists. As a 
result, when there is no upper clip, the CPU 21 returns 
to step SP51. When the upper dip exists, the CPU 21 
proceeds to step SP54 to set the enable/disable flag of 
the clip management data for managing the upper clip 
to disable, thereafter, returns to step SP51. In addition, 
the case of proceeding to the step SP54 is mostly when 
the resultant dip already registered is modified. Further, 
the upper dip includes not only the upper clip having the 
resultant dip produced at step SP52 as a lower clip, but 
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also includes the resultant clip having this upper clip fur- 
ther as a lower clip and at least all resultant clips using 
this resultant clip as a material (hereinafter, referred to 
as associated clips). 

For example, it is assumed that the relation t 
between each material clip and the resultant clip is as 
shown in Fig. 26. More specifically, a resultant clip FC- 
G is produced from material clips MC-G1 and MC-G2. 
and a resultant dip FC-E is produced from the resultant 
clip FC-G and material clips MC-E1 and MC-E2 as 
materials. A resultant clip FC-C is produced from the 
resultant clip FC-E and a material clip MC-C1 as mate- 
rials. 

Further, a resultant clip FC-F is produced from 
material clips MC-F1, MC-F2, and MC-F3 as materials, 
and a resultant clip FC-D is produced from the resultant 
clip FC-F and material clips MC-D1 and MC-D2 as 
materials. Furthermore, the resultant clip FC-B is pro- 
duced from the resultant clips FC-D and FC-C and 
material clip MC-B1 as materials, and a resultant clip 
FC-A is produced from the resultant clip FC-B as a 
material. 

When there is such relation between clips, as far as 
the modification is not added after the clip video data of 
the respective resultant clips are produced once, the 
enable/olsable flag of the dip management data for 
managing these clips is normally set to enable. How- 
ever, the content of the edit processing of the resultant 
clip FC-E is modified for example, the enable/disable 
flag of the resultant clip FC-E is naturally set to disable. 
The enable/disable flag are set to disable not only for 
the resultant dip FC-E but also for the resultant dips 
FC-C and FC-D which have the resultant clip FC-E as a 
lower clip, the resultant clip FC-B having the resultant 
clips FC-C and FC-D as lower dips, and moreover, the 
resultant dip FC-A having the resultant clip FC-B as a 
lower clip. 

The flowchart shown in Fig. 25 is explained again. 
As the result of the determination of step SP51, in the 
case where the edit processing is not inputted spedally, 
the CPU 21 proceeds to next step SP55. At step SP55, 
the CPU 21 determines whether or not the resultant dip 
displayed at the video area of the time line window 51 
has been seleded. When the displayed resultant clip 
has been selected, the CPU 21 starts up the module 
which has produced the resultant clip (i.e., the compos- 
ite module CM or the special effect module SM) at step 
SP56. When the displayed resultant clip is not selected, 
the CPU 21 proceeds to step SP58. Note that the 
details of step SP56 will be descrfced later. 

At step SP58, the CPU 21 determines whether or 
not the re-execution instruction is input and when it is 
input, proceeds to step SP59 to perform the re-execu- 
tion processing. When the re-execution instruction is 
not input, the CPU 21 returns to the original flowchart 
through step SP26. In addition, the re-execution 
described here means that the view button or the all 
view button displayed on the GUI screen is clicked by 



the mouse 2D and the instruction of the view or all view 
is input. At the time of the view or all view, the content of 
the specified edit processing is actually executed to pro- 
duce the video clip data of the resultant dip, so that 
such name is given. 

Here, the concrete processing of the step SP56 
described above (that is, the start-up processing of the 
module) is shown in Fig. 27. As shown in Fig. 27, when 
the displayed resultant clip is selected, the CPU 21 

io reads out the dip management data of the selected 
resultant dip at step SP61 entering from step SP60. 
Next, at step SP62, the CPU 21 refers a module ID code 
registered in the clip management data and starts up 
the module corresponding to the module ID code (that 

is is, the composite module CM or the spedal effect mod- 
ule SM) at step SP63, to display the content of the edit 
processing of the resultant dip on the time line window 
of the GUI. 

Then, the concrete processing of step SP59 
20 described above (i.e.. the re-execution processing) is 
shown in Fig. 28. However, in Fig. 28. there is the rela- 
tion between dips shown in Rg. 26, and at the same 
time the resultant clips FC-E, FC-D. FC-C, FC-B, and 
FC-A are ail disable by the processing of step SP54 
25 explained above. 

As shown in Rg. 28, when the re-execution is 
instructed, the CPU 21 forms a stack memory on the 
RAM 21 B and pushes the clip management data of the 
resultant clip positioned at the uppermost of the clip tree 
30 onto the stack memory. For example, in the example 
shown in Fig. 26, since the resultant clip FC-A is at the 
uppermost position, the dip management data of the 
resultant clip FC-A is pushed on the stack memory. 
Note that pushing means that data is piled up in the 
35 stack memory space. 

At next step SP72, the CPU 21 determines whether 
or not the stack memory is empty. In the present state, 
at step SP71, data exists since the dip management 
data is pushed onto the stack memory, so that the neg- 
40 ative result is obtained. Thereby, the CPU 21 proceeds 
to step SP74. 

At step SP74, the CPU 21 pops the clip manage- 
ment data for one clip from the stack memory, and 
determines whether or not the clip is enable based on 
45 the enable/disable flag of the dip management data. In 
the example shown in Fig. 26, since the resultant clip 
FC-A is disable, the negative result is obtained and the 
CPU 21 proceeds to step SP75. Note that popping 
means that the data piled up in the stack memory space 
so is read out from the uppermost data. 

At step SP75, the CPU 21 determines whether or 
not the lower dip of the resultant clip is all enable based 
on the clip management data read out at the former step 
SP74. In this case, the CPU 21 refers the child link ID 
55 code registered in the dip management data of the 
resultant clip to determine the lower dip based on the 
dip ID code registered there, and refers the enable/dis- 
able flag of the lower clip from the dip database to 
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determine whether or not the lower clips are all enable 
clips. In the example shown in Fig. 26, the resultant clip 
FC-B being the lower clip of the resultant clip FC-A is 
disable, so that the negative result is obtained and the ' 
CPU 21 proceeds to next step SP77. 

At step SP77, the CPU 21 pushes again the clip 
management data of the resultant clip popped before, 
and proceeds to next step SP78. In the example shown 
in Fig. 26, the clip management data of the resultant clip 
FC-A is pushed again onto the stack memory. At step 
SP78, the CPU 21 pushes one clip management data of 
the disable clip among the lower clips of the resultant 
clip re-pushed at step SP77 onto the stack memory. In 
the example shown in Fig. 26, the lower clip FC-B of the 
resultant clip FC-A is disable, so that the dip manage- 
ment data of the resultant clip FC-B is pushed onto the 
stack memory. 

Next, the CPU 21 returns to step SP72 again to 
determine whether or not the stack memory is empty. In 
the present state, since the clip management data 
exists in the stack memory, the negative result is 
obtained and proceeds to step SP74. At step SP74, the 
CPU 21 pops the clip management data for one clip 
from the stack memory, and determines whether or not 
the clip is enable based on the enable/disable flag of the 
clip management data. In the example shown in Fig. 26. 
since the clip management data of the resultant clip FC- 
B is read out but the resultant clip FC-B is disable, the 
negative result is obtained and proceeds to step SP75. 

At step SP75, the CPU 21 determines whether or 
not the lower clips of the resultant clip are all enable 
based on the dtp management data read out at the 
former step SP74. In the example shown in Fig. 26, the 
resultant dips FC-C and FC-D being the lower clips of 
the resultant dip FC-B is disable, so that the negative 
result is obtained and proceeds to step SP77. 

At step SP77, the CPU 21 pushes again the clip 
management data of the resultant dip popped before, 
and proceeds to next step SP78. In the example shown 
in Fig. 26, the clip management data of the resultant dip 
FC-B is pushed again. At next step SP78, the CPU 21 
pushes one clip management data of the disable dip 
among the lower clips of the resultant dip re-pushed at 
step SP77 onto the stack memory. In the example 
shown in Fig. 26, the dip management data of the 
resultant clip FC-C is pushed. 

Next, the CPU 21 returns to step SP72 again to 
determine whether or not the stack memory is empty. In 
the present state, the negative result is obtained since it 
is not empty, and proceeds to step SP74. At step SP74, 
the CPU 21 pops the dip management data for one clip 
from the stack memory, and determines whether or not 
the resultant dip is enable based on the dip manage- 
ment data. In the example shown in Fig. 26, since the 
clip management data of the resultant clip FC-C is read 
out but the resultant clip FC-C is disable, the negative 
result is obtained and proceeds to step SP75. 

At step SP75, the CPU 21 determines whether or 



not the lower dips of the resultant clip are all enable 
based on the clip management data read out at the 
former step SP74. In the example shown in Fig. 26, the 
resultant clip FC-E being the lower clip of the resultant 

5 dip FC-C is disable, so that the negative result is 
obtained and proceeds to step SP77. 

At step SP77, the CPU 21 pushes again the clip 
management data of the resultant clip popped before 
onto the stack memory, and proceeds to next step 

w SP78. In the example shown in Fig. 26, the dip man- 
agement data of the resultant clip FC-C is pushed 
again. At next step SP78, the CPU 21 pushes one dip 
management data of the disable clip among the lower 
dips of the resultant dip re-pushed at step SP77 onto 

75 the stack memory. In the example shown in Fig. 26, the 
dip management data of the resultant dip FC-E is 
pushed. 

Next, the CPU 21 returns to step SP72 again to 
determine whether or not the stack memory is empty. In 

20 the present state, the negative result is obtained since it 
is not empty, and proceeds to next step SP74. At step 
SP74, the CPU 21 pops the dip management data for 
one clip from the stack memory, and determines 
whether or not the resultant clip is enable based on the 

25 dip management data. In the example shown in Fig. 26. 
since the resultant clip FC-E is read out but the resultant 
clip FC-E is disable, the negative result is obtained to 
proceed to step SP75. 

At step SP75, the CPU 21 determines whether or 

30 not the lower dips of the resultant clip are all enable 
based on the dip management data read out at the 
former step SP74. In the example shown in Fig. 26. 
since the clips MC-E1, MC-E2. and FC-G which are 
lower clips of the resultant clip FC-E are all enable, the 

35 affirmative result is obtained, and proceeds to step 
SP76. 

At step SP76, the CPU 21 performs the edit 
processing using the clip video data of the dip specified 
as a material based on the work data registered in the 

40 dip management data, so as to produce the dip video 
data of the resultant clip and changes the enable/disa- 
ble flag of the dip management data of the resultant dip 
into enable. In the example shown in Fig. 26, the edit 
processing is performed by using the clips FC-G, MC- 

45 E1, and MC-E2 specified as materials to produce the 
dip video data of the resultant dip FC-E and change the 
enable/disable flag of the resultant clip FC-E into ena- 
ble. 

Next, the CPU 21 returns to step SP72 again to 
so determine whether or not the stack memory is empty. In 
the present state, the negative result is obtained since it 
is not empty, and proceeds to step SP74. At step SP74. 
the CPU 21 pops the dip management data for one dip 
from the stack memory, and determines whether or not 
55 the resultant clip is enable based on the dip manage- 
ment data. In the example shown in Fig. 26, since the 
dip management data of the resultant clip FC-C is read 
out but the resultant dip FC-C is disable, the negative 
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result is obtained and proceeds to step SP75. 

At step SP75, the CPU 21 determines whether or 
not the lower clips of the resultant dip are all enable 
based on the clip management data read out at the 
former step SP74. In the example shown in Fig. 26, the s 
clips FC-E and MC-C1 being the lower dips of the 
resultant clips FC-C are enable, so that the affirmative 
result is obtained and proceeds to step SP76. 

At step SP76, the CPU 21 performs the edit 
processing using the clip video data of the dip specified 10 
as a material based on the work data registered in the 
clip management data, so as to produce the clip video 
data of the resultant clip and changes the enable/disa- 
ble flag of the clip management data of the resultant dip 
into enable. In the example shown in Fig. 26, the edit is 
processing is performed by using the clips FC-E and 
MC-C1 to produce the clip video data of the resultant 
clip FC-C and change the enable/disable flag of the 
resultant dip FC-C into enable. 

Next, the CPU 21 returns to step SP72 again to 20 
determine whether or not the stack memory is empty. In 
the present state, the negative result is obtained since it 
is not empty, and proceeds to step SP74. At step SP74, 
the CPU 21 pops the clip management data for one clip 
from the stack memory, and determines whether or not 25 
the resultant dip is enable based on the dip manage- 
ment data. In the example shown in Fig. 26, since the 
clip management data of the resultant clip FC-B is read 
out but the resultant clip FC-B is disable, the negative 
result is obtained and proceeds to step SP75. 30 

At step SP75, the CPU 21 determines whether or 
not the lower clips of the resultant dip are all enable 
based on the clip management data read out at the 
former step SP74. In the example shown in Fig. 26, the 
resultant dip FC-D being the lower dip is disable, so 35 
that the negative result is obtained and proceeds to step 
SP77. 

At step SP77, the CPU 21 pushes again the dip 
management data of the resultant dip onto the stack 
memory similarly, and at next step SP78, pushes the 40 
clip management data of the disable lower clip onto the 
stack memory. 

Next the CPU 21 returns to step SP72 again to 
determine whether or not the stack memory is empty. In 
the present state, the negative result is obtained since it 45 
is not empty, and proceeds to step SP74. At step SP74, 
the CPU 21 pops the clip management data for one dip 
from the stack memory, and determines whether or not 
the resultant dip is enable based on the dip manage- 
ment data. In the example shown in Rg. 26, since the so 
resultant dip FC-D is read out but the resultant dip FC- 
D is disable, the negative result is obtained and pro- 
ceeds to step SP75. 

At step SP75, the CPU 21 determines whether or 
not the lower clips of the resultant dip are all enable ss 
based on the clip management data read out at the 
former step SP74. In the example shown in Rg. 26. the 
clips FC-E, FC-F, MC-D1 and MC-D2 being lower dips 



of the resultant clip FC-D are all enable, so that the 
affirmative result is obtained and proceeds to step 
SP76. 

At step SP76, the CPU 21 performs the edit 
processing using the clip video data of the dip specif ied 
as a material based on the work data registered in the 
dip management data, so as to produce the dip video 
data of the resultant dip and changes the enable/disa- 
ble flag of the clip management data of the resultant clip 
into enable. In the example shown in Rg. 26, the edit 
processing is performed by using the clips FC-E, FC-F, 
MC-D1 and MC-D2 to produce the clip video data of the 
resultant dip FC-D and change the enable/disable flag 
of the resultant dip FC-D into enable. 

Next, the CPU 21 returns to step SP72 again to 
determine whether or not the stack memory is empty. In 
the present state, the negative result is obtained since it 
is not empty, and proceeds to step SP74. At step SP74, 
the CPU 21 pops the clip management data for one dip 
from the stack memory, and determines whether or not 
the resultant clip is enable based on the clip manage- 
ment data. In the example shown in Fig. 26, since the 
clip management data of the resultant dip FC-B is read 
out but the resultant dip FC-B is disable, the negative 
result is obtained and proceeds to step SP75. 

At step SP75, the CPU 21 determines whether or 
not the lower clips of the resultant clip are all enable 
based on the clip management data read out at the 
former step SP74. In the example shown in Rg. 26. the 
resultant dips FC-C and FC-D being lower dips are 
enable, so that the affirmative result is obtained and 
proceeds to step SP76. 

At step SP76, the CPU 21 performs the edit 
processing using the clip video data of the clip specified 
as a material based on the work data registered in the 
dip management data, so as to produce the dip video 
data of the resultant clip and changes the enable/disa- 
ble flag of the clip management data of the resultant clip 
into enable. In the example shown in Fig. 26, the edit 
processing is performed by using the dips FC-C and 
FC-D to produce the dip video data of the resultant clip 
FC-B and change the enable/disable flag of the result- 
ant dip FC-B into enable. 

Next, the CPU 21 returns to step SP72 again to 
determine whether or not the stack memory is empty. In 
the present state, the negative result is obtained since it 
is not empty, and proceeds to step SP74. At step SP74, 
the CPU 21 pops the clip management data for one clip 
from the stack memory, and determines whether or not 
the resultant dip is enable based on the clip manage- 
ment data. In the example shown in Fig. 26, since the 
dip management data of the resultant clip FC-A is read 
out but the resultant clip FC-A is disable, the negative 
result is obtained and proceeds to step SP75. 

At step SP75, the CPU 21 determines whether or 
not the lower clips of the resultant clip are all enable 
based on the dip management data read out at the 
former step SP74. In the example shown in Fig. 26, the 
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resultant clip FOB being lower dip is enable, so that the 
affirmative result is obtained and proceeds to step 
SP76. 

At step SP76. the CPU 21 performs the edit 
processing using the dip video data of the clip specified s 
as a material based on the work data registered in the 
clip management data, so as to produce the clip video 
data of the resultant clip and changes the enable/disa- 
ble flag of the dip management data of the resultant dip 
into enable. In the example shown in Fig. 26, the edit io 
processing is performed by using the resultant clip FC- 
B to produce the clip video data of the resultant clip FO 
A and change the enable/disable flag of the resultant 
dip FC-A into enable. 

Next, the CPU 21 returns to step SP72 again to is 
determine whether or not the stack memory is empty. In 
the present state, the stack memory is empty since the 
all data to the uppermost resultant dip are read out by 
pop processing described above, and an affirmative 
result is obtained. Therefore, the CPU 21 proceeds to 20 
step SP73 to complete the re-execution processing. 

In addition, at step SP74, if it is determined that the 
clip of the clip management data read from the stack 
memory is enable, the CPU 21 returns to step SP72. 
For example, when the uppermost resultant clip is ena- 25 
We in the clip tree, the dip management data is pushed 
onto the stack memory by the processing of step SP71 . 
However, since the affirmative result is obtained by 
determination of step SP74, the CPU 21 returns to step 
SP72 to complete the re-execution processing immedi- 30 
ately because the affirmative result is obtained. In this 
way, when the uppermost resultant clip is enable, the re- 
execution processing is not performed actually. 

Here, the content of the flowchart of the re-execu- 
tion processing described above is shown in Fig. 29 35 
schematically. In the editing system 1 according to this 
invention, when the uppermost resultant clip FC-A is 
disable, it is determined whether the resultant clip FC-B 
which is the lower clip of the clip FC-A is enable or not, 
and when it is disable, it is determined whether the clip 4c 
FC-C which is the lower clip of the clip FC-B is enable or 
not. As a result, when the resultant dip FC-C is disable, 
it is determined whether the clip FOE which is the lower 
clip of the resultant dip FC-C is enable or not, and when 
the resultant dip FOE is disable, it is determined 4i 
whether the dip FOG which is the lower clip of the 
resultant clip FOE is enable or not. 

As a result if the resultant dip FC-G is enable, the 
clip video data of the resultant clip is transferred to exe- 
cute the edit processing based on the dip video data a 
again, so as to produce the dip video data of the result- 
ant clip FOE corresponding to the upper dip. When the 
dip video data of the resultant dip FC-E is produced, 
the edit processing based on the clip video data is exe- 
cuted again, so as to produce the clip video data of the s 
resultant dip FC-C corresponding to the upper clip. 
When the dip video data of the resultant clip FC-C is 
produced, the edit processing based on the clip video 



data is tried to be executed again. However, since the 
resultant clip FC-D which is the other lower dip is still 
disable, it is determined whether the resultant clip FC-E 
which is the lower dip of the resultant clip FOD is ena- 
ble or not. 

If the resultant clip FOE is enable, the dip video 
data of the resultant clip FC-E is transferred. Also, it is 
determined whether the resultant dip FC-F which is the 
other lower dip of the resultant clip FC-D is enable or 
not, and when it is enable, the clip video data of the 
resultant dip FC-F is also transferred. When the dip 
video data from the lower clips FC-E and FC-F are 
transferred, the edit processing based on the clip video 
data is executed again, so as to produce the clip video 
data of the resultant dip FOD corresponding to the 
upper dip Next, when the clip video data of the result- 
ant clip FC-D is produced, the edit processing based on 
the dip video data is executed again, so as to produce 
the clip video data of the resultant clip FC-B corre- 
sponding to the upper clip. Next, when the clip video 
data of the resultant dip FC-B is produced, the edit 
processing based on the dip video data is executed 
again, so as to produce the clip video data of the result- 
ant clip FC-A corresponcfing to the upper clip. 

In this way, in the editing system 1 according to this 
invention, if the content of the edit processing of the 
resultant clip FC-E is modified, the flag for identifying 
the resultant clip FC-E is changed to disable and the 
flags for identifying the resultant dips FOC t FC-D, FO 
B, and FC-A which are linked to the upper position of 
the resultant dip FOE are all changed to disable. Then, 
the re-execution processing is specified by seleding the 
command of the view or the all view, is determined 
whether the clips is enable or not from the uppermost 
resultant clip FC-A toward the lower dips. When 
reached to the clip having all enable dips linked at the 
lower position, the edit processing of the clip is re-exe- 
cuted to change the dip into the enable clip, and the edit 
processing of the dip which are linked at the upper posi- 
tion is successively re-executed to change all clips 
which are linked at the upper position into enable clips. 
Thus, in the editing system 1 according to this invention, 
such processing is performed so as to easily modify the 
edit result once produced, even if the operator does not 
remember the relation between dips conventionally. 

(7) Operation and effect of the editing system 

With the above construction, when the editing sys- 
» tern 1 is started up, the top menu is displayed on the dis- 
play 2B of the work station 2. An operator selects the 
command of starting up a desired module on the top 
menu, and starts up the module suitable to the edit work 
which will be performed. When the module is started up, 
f the GUI for editing is displayed on the display 2B of the 
work station 2. 

For example, when the composite module CM is 
started up, the GUI shown in Fig. 10 is displayed on the 
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display 2B. in the GUI for composite processing, the 
time line window 34 only for the composite processing is 
displayed, and the clip being a material can be easily 
specified or a desired composite processing can be 
specified. At this time, in the GUI, the clips registered as 
the clip database CDB are displayed on the clip tree 
window 31 or the library window 33. and if a desired clip 
is selected among from these clips as a material and 
placed at the video area of the time line window 34. the 
material of composite processing can be easily sped- w 
tied. 

Further, to set the parameter of the composite 
processing specified on the time line window 34, the 
parameter is set with viewing the screen by using the 
parameter setting window 35 displayed on the same is 
GUI, so that a desired composite parameter can be set- 
Further, on the clip tree window 31, the clip tree 
such that the relation between respective clips regis- 
tered in the clip database CDB is understood is dis- 
played. When viewing the clip tree, it can be easily 20 
obtained that which of clips is each clip produced from 
as a material. 

Similarly, when the special effect module SM is 
started up. the GUI shown in Fig. 1 1 is displayed on the 
display 2B. Also in the GUI of the special effect process- 2s 
ing, the time line window 41 only for the special effect is 
displayed, and if you operates in accordance with the 
time line window 41. the clip being a material can be 
easily specified or a desired special effect processing 
can be specified. Moreover, also in the GUI of the spe- 30 
cial effect processing, the clip tree window 31 and the 
library window 33 are provided, so that the desired clip 
registered in the clip database CDB can be easily 
selected as a material. 

Similarly, when the edit module EM is started up. 35 
the GUI shown in Fig. 1 2 is displayed on the display 2B. 
Also in the GUI of the edit processing, the time line win- 
dow 51 only for the edit processing is displayed, and if 
you operates in accordance with the time line window 
51 , the clip being a material can be easily specif ied or a 40 
desired edit processing can be specified. 

In this way, in the editing system 1, the desired 
material or the edit content is specified with viewing the 
GUI displayed on the display 2B of the work station 2, so 
as to easily perform the desired edit work. Further, in 45 
the editing system 1, various instructions relating to the 
edit work can be input through the work station 2. and 
the edit work can be performed easily even if the opera- 
tor does not operate intentionally various devices as a 
conventional way. 50 

Therefore, in the editing system 1 , the edit work can 
be performed easier and higher in speed as compared 
with the conventional one. Also, the many types of 
materials registered in the clip database CDB are used 
to obtain the complicated and high quality video data. 55 

On the other hand, in the editing system 1 , each clip 
being as a material is managed with the hierarchical 
structure based on the relation between clips. More 



specifically, it is understood that which of clips is the clip 
linked to. Therefore, even rf the content of the edit is 
changed after the edit work has been performed once, 
the associated clips can be changed automatically by 
the management of the hierarchical structure. Thereby, 
the edit work can be easily changed and the edit work is 
performed efficiently even "rf the operator does not inten- 
tionally remember the relation between clips. Further- 
more, even rf the ecfit content is changed, the original 
work data relating to the edit is remained so as to return 
it to the original state after the edit content has been 
changed. Further, the relation between clips is man- 
aged with the hierarchical structure, so that the edit 
work is successively performed based on the relation 
between clips managed with the hierarchical structure 
to perform the complicated edit work easily. 

In accordance with the above construction, the 
work station 2 displaying the GUI for each function is 
provided to enable to input the various edit instructions 
in accordance with the screen of the GUI, so that the 
desired edit work can be performed without the opera- 
tion of devices as conventional one, and the editing sys- 
tem which significantly improves the usability can be 
realized. 

Further, respective clips being as materials are 
managed with the hierarchical structure based on the 
relation between clips, so that the complete edit work 
can be performed easily and the edit work can be 
changed easily, thereby the editing system which can 
perform the complicated edit work easily and rapidly 
can be realized. 

Industrial Applicability 

In the broadcasting station, etc., this invention can 
be utilized in the complicated edit work using a plurality 
of materials. 

DESCRIPTION OF REFERENCE NUMERALS 

1... editing system, 2... work station. 2A...body, 
2B„.dispiay, 2C...key board, 2D...mouse, 2E...pen 
tablet. 3.. .device controller, 4... exclusive controller, 
5.. .video disk recorder. 6... video tape recorder, 
7.. .switcher, 8.. .video camera, 9...dig*rtal multi-effec- 
tor, 10...monitor, 11. ..audio mixer, 20...system bus, 
21. ..CPU, 21A...ROM, 21B...RAM. 22...video proc- 
essor. 23...display controller. 24...HDD interface. 
25... FDD interface, 26... pointing device interface. 
27.. .external interface. 30...menu window, 31. ..dip 
tree window, 32... key window, 33.. .library window, 
34, 41 , 51 ...time line window, 35.. .parameter setting 
window, 36...preview screen display window, 
37...device control window, 38...ed*rt content olsplay 
window. 39... control command window, 40. 
50... effect selection window, 42, 52... parameter set- 
ting window. 
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Claims 

1. An editing system for producing edit resultant clip 
from a plurality of clips to be edited, comprising: 

editing means, which is composed of a plurality 
of processing modules for editing the clips to 
be edited, for performing on a plurality of clips 
to be edited the edit processing corresponding 
to the processing module selected among from 
the plurality of processing modules to produce 
edit resultant clip; 

managing means for managing said edit result- 
ant clip and said plurality of clips to be edited 
with the hierarchical structure, in order to show 
that which of clips to be edited is said edit 
resultant clip produced from; and 
control means for controlling said editing 
means based on the information managed by 
said managing means. 

2. The editing system according to claim 1 , wherein 

said managing means has a clip database to 
register for each clip the information of a plural- 
ity of said clips. 

3. The editing system according to claim 2, wherein 

said clip database includes the link information 
indicating the link state of said clips managed 
with the hierarchical structure. 

4. The editing system according to claim 3, wherein 

said link information registered for each clip 
consists of the lower link information indicating 
the lower clips linked to said clip at a lower 
position and the upper link information indicat- 
ing the upper clips linked to said clip at an 
upper position. 

5. The editing system according to claim 4, wherein 

said managing means register said clips to be 
edited in said dip database as a lower dip of 
said edit resultant clip,' so as to correspond to 
the layer specified in the processing module 
and corresponding to said edit resultant dip. 

6. The editing system according to claim 4, wherein: 

said plurality of clips to be edited include the 
first clip to be edited and the second clip to be 
edited; and 

said managing means register said first dip to 
be edited in said dip database as a lower clip 
firstly linked to said edit resultant clip and regis- 



ters said second clip to be edited in said clip 
database as a lower clip secondly linked to said 
edit resultant dip, when said first clip to be 
edited is specified as the first layer and said 
5 second dip to be edited is specified as the sec- 

ond layer in the processing module selected in 
producing said edit resultant clip. 

7. The editing system according to daim 2, wherein: 

70 

said plurality of processing modules comprise 
an edit module for editing said edit resultant 
clip, a composite module for composing said 
edit resultant dip, and a special effect module 
75 for applying a special effect to said edit result- 

ant clip. 

8. The editing system according to daim 7, further 
comprising 

20 

image processing means for applying the 
image processing respectively corresponding 
to said edit module, said composite module, 
and said special effect module to the video 
25 data of said dip to be edited. 

9. The editing system according to daim 8, further 
comprising 

30 display means for displaying the graphical user 

interface respectively corresponding to said 
edit module, said composite module, and said 
spedal effect module on a display. 

35 10. The editing system according to daim 8, wherein 

said dip database has the module identification 
information indicating that which of said plural- 
ity of processing modules is said edit resultant 
40 clip produced among from. 

11. The editing system according to daim 10, wherein 

said control means controls said ecfiting means 
45 and said image processing means based on 

the information registered in said clip database. 

12. The editing system according to claim 10, wherein 

so said control means controls said editing means 

based on said module identification information 
of the edit resultant dip specified by an edit 
operator. 

55 13. "The editing system according to claim 10, wherein 

said control means controls said editing means 
so as to start up the processing module corre- 
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sponding to the edit resultant clip specified by 
an edit operator based on said module identifi- 
cation information stored in said clip database. 



said edit resultant clip and the time code in said 
clip to be edited which are associated each 
other. 



14. The editing system according to claim 10, wherein 5 20. The editing system according to claim 14. wherein 



said clip database has edit point data indicating 
a plurality of editing points specified in produc- 
ing said edit resultant clip and image process- 
ing data indicating the image processing 
applied to the video data of said clip to be 
edited to produce said edit resultant clip. 

15. The editing system according to claim 14, wherein 

said control means controls the image process- 
ing timing of said image processing means 
based on said editing point data registered in 
said clip database, and controls the image 
processing operation of said image processing 
means. 

16. The editing system according to claim 14, wherein 

said editing point data is data representing the 
edit start point and the edit end point of said 
clip to be edited, and data representing the 
change point of said image processing data 
applied to the video data of said edit resultant 
dip. 

17. The editing system according to claim 16, wherein 

said editing point data is represented by time 
code in said edit resultant dip and time code in 
said clip to be edited. 

18. The editing system according to claim 17, wherein 

the time code representing the editing point in 
said dip to be edited is stored in said dip data- 
base so as to be assodated with the time code 
indicating the editing point specified in said edit 
resultant dip. 

19. The editing system according to claim 16, wherein: 

said edit resultant clip and said dip to be edited 
respectively have the original time code start- 
ing from the start point of each dip; and 
said managing means registers, at the edit 
start point of said dip to be edited, in said clip 
database as said editing point data the time 
code in said edit resultant clip and the time 
code in said dip to be edited which are assod- 
ated each other, and registers at the edit end 
point of said dip to be edited in said dip data- 
base as said editing point data the time code in 



said image processing data consists of edit 
processing data indicating the content of the 
image processing corresponding to the edit 
w processing specified by said edit module, the 

composite processing data indicating the con- 
tent of the image processing corresponding to 
the composite processing specified by said 
composite module, and the spedal effect 
75 processing data indicating the content of the 

image processing corresponding to the special 
effect processing specified by said special 
effect module. 

20 21. The editing system according to daim 20, wherein 

said edit data consists of edit processing iden- 
tification data indicating the type of edit 
processing set by said edit module and a plu- 
25 rality of edit processing parameters corre- 

sponding to the edit processing. 

22. The editing system according to claim 21 , wherein 
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said edit processing parameters are registered 
in said clip database so as to correspond to 
said editing point specified in said edit resultant 
clip. 

23. The editing system according to claim 22, wherein 

said control means controls said image 
processing means so as to perform on the 
video data of said clip to be edited the image 
processing" in accordance with said edit 
processing parameters corresponding to said 
editing point at a timing in accordance with said 
editing point. 



45 24. The editing system according to claim 22, wherein: 

the editing point specified for said edit resultant 
clip includes the first editing point and the sec- 
ond editing point; 
so said edit processing parameters include the 

first edit processing parameter set to a timing 
corresponding to said f irst editing point and the 
second edit processing parameter set to a tim- 
ing corresponding to said second editing point; 
55 and 

said control means controls said image 
processing means so as to perform the image 
processing in accordance with said first edit 
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parameter on the video data of said clip to be 
edited at a timing of said first editing point and 
controls said image processing means so as to 
perform the image processing in accordance 
with said second edit parameter on the video s 
data of said clip to be edited at a timing of said 
second editing point 

25. The editing system according to claim 24, wherein 

said control means controls said image 
processing means so as to perform the image 
processing in accordance with the interpolation 
parameter interpolated between said first edit 
parameter and said second edit parameter on 
the video data of said clip to be edited during 
the period from said first editing point to said 
second editing point. 

26. The editing system according to claim 21 , wherein 

said control means further has display means 
for displaying the cell showing the edit section 
of said clip to be edited and the change of said 
edit processing parameters specified for said 
clip to be edited, which correspond to the time 
axis direction. 



the first composite processing parameter set to 
a timing corresponding to said first editing point 
and the second composite processing parame- 
ter set to a timing corresponding to said second 
editing point; and 

said control means controls said image 
processing means so as to perform the image 
processing in accordance with said first com- 
posite parameter on the video data of said clip 
to be edited at a timing of said first editing point, 
and controls said image processing means so 
as to perform the image processing in accord- 
ance with said second composite parameter on 
the video data of said clip to be edited at a tim- 
ing of said second editing point 

31. The editing system according to claim 30, wherein 

said control means produces a plurality of inter- 
polation parameters based on said first com- 
posite processing parameter and said second 
composite processing parameter, and controls 
said image processing means so as to perform 
the image processing in accordance with said 
plurality of interpolation parameters during the 
period from said first editing point to said sec- 
ond editing point. 
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27. The editing system according to claim 20, wherein 

30 

said composite processing data consists of a 
plurality of composite processing parameters 
corresponding to the composite processing set 
by said composite module. 

35 

28. The editing system according to claim 27, wherein 

said plurality of composite processing parame- 
ters are registered in said clip database so as 
to correspond to said editing point specified in 40 
said edit resultant clip. 

29. The editing system according to claim 28, wherein 

said control means controls said image 45 
processing means so as to perform on the 
video data of said clip to be edited the image 
processing in accordance with said composite 
processing parameters corresponding to said 
editing point at a timing in accordance with said so 
editing point. 

30. The editing system according to claim 28, wherein: 

the editing point specified for said edit resultant 55 
clip includes the first editing point and the sec- 
ond editing point; 

said composite processing parameters include 



32. The editing system according to claim 31 , wherein 

said control means further has display means 
for displaying the cell showing the edit section 
of said clip to be edited and the change of said 
composite processing parameters specified for 
said clip to be edited, which correspond to the 
time axis direction. 

33. The editing system according to claim 20, wherein 

said special effect processing data consists of 
special effect identification data indicating the 
type of special effect processing set by said 
special effect module, and a plurality of special 
effect parameters corresponding to said spe- 
cial effect processing. 

34. The editing system according to claim 33, wherein 

said plurality of special effect processing 
parameters are registered in said clip database 
so as to correspond to said plurality of editing 
points specified in said edit resultant clip. 

35. The editing system according to claim 34, wherein 

said control means controls said image 
processing means so as to perform on the 
video data of said clip to be edited the image 



32 



63 



EP 0 863 510 A1 



64 



processing in accordance with said special 
effect processing parameters corresponding to 
said editing point at a timing in accordance with 
said editing point. 

5 

36. The editing system according to claim 34, wherein: 

the editing point specified for said edit resultant 
clip includes the first editing point and the sec- 
ond editing point; 10 
said special effect processing parameters 
include the first special effect processing 
parameter set to a timing corresponding to said 
first editing point and the second special effect 
processing parameter set to a timing corre- is 
spending to said second editing point; and 
said control means controls said image 
processing means so as to perform the image 
processing in accordance with said first special 
effect parameter on the video data of said clip 20 
to be edited at a timing of said f irst editing point, 
and controls said image processing means so 
as to perform the image processing in accord- 
ance with said second special effect parameter 
on the video data of said clip to be edited at a zs 
timing of said second editing point. 

37. The editing system according to claim 36, wherein 

said control means produces a plurality of inter- 30 
polation parameters based on said first special 
effect processing parameter and said second 
special effect processing parameter, and con- 
trols said image processing means so as to 
perform the image processing in accordance 35 
with said plurality of interpolation parameters 
during the period from said first editing point to 
said second editing point. 

38. The editing system according to claim 37, wherein 40 

said control means further has display means 
for displaying the cell showing the edit section 
of said clip to be edited and the change of said 
special effect processing parameters specified 45 
for said clip to be edited, which correspond to 
the time axis direction. 

39. The editing system according to daim 14, wherein 

so 

said control means makes all clips linked to the 
upper position of the modif ied edit resultant clip 
disable, when said edit resultant dip registered 
in said clip database is modified. 

55 

40. The editing system according to claim 14, wherein 

sard control means produces a new edit result- 



ant clip instead of the edit resultant dip before 
modification when said edit resultant clip is 
modified, and makes all dips linked to the 
upper position of the edit resultant dip before 
modification disable. 

41. The editing system according to claim 40, wherein 

said database has the identification flag indi- 
cating whether said each clip is enable or disa- 
ble. 

42. The editing system according to daim 40, wherein 

said managing means, 

registers said new edit resultant clip in said clip 
database with the clip identification code or dip 
name representing said edit resultant dip 
before modification, and 
registers said edit resultant dip before modifi- 
cation in said dip database with the clip identi- 
fication code or clip name which is different 
from the clip identification code or clip name 
representing said edit resultant clip before 
modification. 

43. The editing system according to claim 14, wherein 

said control means produces a new edit result- 
ant dip instead of said edit resultant dip before 
modification when said edit resultant clip is 
modified, and searches all clips linked to the 
upper position of said edit resultant clip before 
modification based on said link information of 
said clip database to make the searched clips 
disable. 

44. The editing system according to claim 43, wherein 

said managing means, 

registers the information relating to said new 
edit resultant clip in said dip database with the 
clip identification code or dip name represent- 
ing said edit resultant dip before modification, 
and 

registers the information relating to said edit 
resultant clip before modification in said clip 
database with the dip identification code or dip 
name which is different from the dip identifica- 
tion code or dip name representing said edit 
resultant dip before modification. 

45. The editing system according to claim 44, wherein 

said clip database has the identification flag 
indicating whether said each dip is enable or 
disable. 
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46. The editing system according to claim 45, wherein 

said control means has re-execution means for 
re-executing in order to make said edit result- 
ant clip which has been made disable by the 
modification processing enable. 

47. The editing system according to claim 46, wherein 

said re-execution means having: 

search process for referring said link infor- 
mation and said identification flag of said 
clip database to search the edit resultant 
clip to be re-executed among from said dis- 
able edit resultant clips; and 
production process for producing a new 
video data corresponding to said searched 
edit resultant clip among from the video 
data of all lower clips linked to the lower 
position of the edit resultant clip searched 
by said search process. 

48. The editing system according to claim 47, wherein 

said re-execution means, in said production 
process, produces a new edit resultant clip 
instead of said searched disable edit resultant 
clip, from said newly produced video data, said 
link information relating to said searched edit 
resultant clip registered in said clip database, 
said editing point data, and said image 
processing data. 

49. The editing system according to claim 48, wherein 

said managing means 

registers said edit resultant dip newly pro- 
duced in said clip database with the clip identi- 
fication code or clip name representing said 
searched disable edit resultant clip, and 
registers said searched disable edit resultant 
clip in said clip database with the clip identifica- 
tion code or clip name which is different from 
the clip identification code or clip name repre- 
senting said researched disable edit resultant 

clip. 

50. The editing system according to claim 47, wherein 

said re-execution means repeats said search 
process and said production process until all 
clips managed with the hierarchical structure 
by said managing means become enable. 

51- The editing system according to claim 47, wherein 

said re-execution means performs the re-exe- 



cution on the edit resultant dip which has the 
lower dips being all enable among said disable 
edit resultant dips and which is at the lowest 
position among said clips managed with said 
s hierarchical structure. 

52. The editing system according to daim 47, wherein 

said re-execution means, in said production 
10 process, controls said image processing device 

based on the editing point data and the image 
processing data corresponding to said 
searched disable edit resultant clip, so as to 
produce said new video data. 

15 

53. An editing system for editing a plurality of dips to be 
edited, comprising: 

editing means, which is composed of a plurality 
20 of processing modules for editing the clips to 

be edited, for applying to a plurality of dips to 
be edited the edit processing corresponding to 
the processing module selected among from 
the plurality of processing modules to produce 
25 edit resultant dip; 

storing means for storing the module identifica- 
tion information indicating that which of 
processing modules is said edit resultant clip 
produced by using from; and 
30 control means for starting up the processing 

module corresponding to said edit resultant dip 
based on said module identification data stored 
in said storing means, when said edit resultant 
clip is selected. 

35 

54. The editing system according to claim 53, wherein 

said storing means has a clip database to reg- 
ister for each edit resultant dip said module 
40 identification information. 

55. The editing system according to claim 54, wherein 

said dip database includes the link information 
45 indicating the link state of said clips in the hier- 

archical structure in order to manage said edit 
resultant dip and said plurality of dips to be 
edited with the hierarchical structure. 

so 56. The editing system according to daim 55, wherein 

said plurality of processing modules have an 
edit module for editing said plurality of clips to 
be edited, a composite module for composing 
55 said plurality of clips to be edited, and a spedal 

effect module for applying the spedal effects to 
said plurality of dips to be edited. 
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57. The editing system according to claim 56, further 
comprising: 

user interface means composed of a graphical 
user interface for edit processing correspond- s 
ing to said edit module, a graphical user inter- 
face for composite processing corresponding 
to said composite module, and a graphical user 
interface for special effect processing corre- 
sponding to said special effect module; and io 
display means for displaying said graphical 
user interface for edit processing, said graphi- 
cal user interface for composite processing, 
and said graphical user interface for special 
effect processing on a display; is 
said control means wherein: 

identifies the processing module corre- 
sponding to said selected edit resultant clip 
based on the module identification infor- 20 
mation registered in said clip database; 
and 

starts up the processing module corre- 
sponding to said identified processing 
module and controls said display means to 25 
display the graphical user interface of the 
processing module corresponding to said 
identified processing module. 

58. The editing system according to claim 57, wherein 30 

said clip database has editing point data show- 
ing a plurality of editing points specified in pro- 
ducing said edit resultant clip and image 
processing data showing the content of the ss 
image processing applied to the video data of 
said clip to be edited to produce said edit 
resultant clip. 

59. The editing system according to claim 58, wherein ao 

said control means controls the image process- 
ing timing of said image processing means 
based on said editing point data registered in 
said clip database, and controls the image 45 
processing operation of said image processing 
means based on said image processing data 
registered in said dip database. 

60. The editing system according to claim 58, wherein so 

said editing point data is data representing the 
edit start point and the edit end point of said 
dtp to be edited, and data representing the 
change point of said image processing data 55 
applied to the video data of said edit resultant 
clip. 



61. The editing system according to claim 58, wherein 

said image processing data consists of edit 
processing data indicating the content of the 
image processing corresponding to the edit 
processing specified by said edit module, the 
composite processing data indicating the con- 
tent of the image processing corresponding to 
the composite processing specified by said 
composite module, and the spedal effect 
processing data indicating the content of the 
image processing corresponding to the special 
effect processing specified by said special 
effect module. 

62. The editing system according to claim 61 , wherein 

said edit data consists of edit processing iden- 
tification data indicating the type of edit 
processing set by said edit module and a plu- 
rality of edit processing parameters corre- 
sponding to the edit processing. 

63. The editing system according to daim 62, wherein 

said edit processing parameters are registered 
in said dip database so as to correspond to 
said editing point specified in said edit resultant 
clip. 

64. The editing system according to claim 63, wherein 

said control means controls said image 
processing means so as to perform on the 
video data of said dip to be edited the image 
processing in accordance with said edit 
processing parameters corresponding to said 
editing point at a timing in accordance with said 
editing point. 

65. The editing system according to daim 63, wherein: 

the editing point specified for said edit resultant 
clip includes the first editing point and the sec- 
ond editing point; 

said edit processing parameters include the 
first edit processing parameter set to a timing 
corresponding to said first editing point and the 
second edit processing parameter set to a tim- 
ing corresponding to said second editing point; 
and 

said control means controls said image 
processing means so as to perform the image 
processing in accordance with said first edit 
parameter on the video data of said clip to be 
edited at a timing of said first editing point, and 
controls said image processing means so as to 
perform the image processing in accordance 



35 



69 



EP 0 863 510 A1 



70 



with said second edit parameter on the video 
data of said clip to be edited at a timing of said 
second editing point 



67. The editing system according to claim 62, wherein 

said control means controls display means to 
display the cell showing the edit section of said 
clip to be edited and the change of said edit 
processing parameters specified for said clip to 
be edited, which correspond to the time axis 
direction. 

68. The editing system according to claim 62, wherein 

said control means controls said display means 
to display said plurality of edit processing 
parameters set for said selected edit resultant 
clip on said display as a part of said graphical 
user interface for edit processing, based on the 
information registered in said clip database. 

69. The editing system according to claim 68, wherein 

said control means controls said display means 
to display said edit parameter so as to corre- 
spond to each editing point, in order to visually 
know the change in the time axis direction of 
said plurality of edit processing parameters, 
based on said editing point data and said 
image processing data of said selected edit 
resultant dip. 

70. The editing system according to claim 62, wherein 

while the first processing module is being 
started up to produce the first edit resultant clip, 
when the second edit resultant clip linked as a 
lower clip of said first edit resultant clip is 
selected, 

said control means 

refers said link information, said module identi- 
fication information, said editing point data, and 
said image processing data which are regis- 
tered as the information relating to said second 
edit resultant dip of said clip database, 
starts up the second processing module corre- 



sponding to said second edit resultant clip 
based on said module identification code, and 
controls, based on said link information, said 
editing point data, and said image processing 
data, said display means to display the cell rep- 
resenting the edit section of clip linked to the 
lower position of said second edit resultant clip 
so as to associate with the editing point of said 
editing point data, and to display each process- 
ing parameter of said image processing data 
corresponding to said second processing mod- 
ule so as to associate with the editing point of 
said editing point date. 

is 71. An editing system for editing a plurality of dips to be 
edited, comprising: 

editing means, which is composed of a plurality 
of processing modules for editing said dips to 

20 be edited, for applying to a plurality of dips to 

be edited the edit processing corresponding to 
the processing module selected among from 
the plurality of processing modules to produce 
edit resultant dip; 

25 - display means for displaying the graphical user 

interface corresponding to said plurality of 
processing modules on a display; 
storing means for storing the image processing 
data indicating the content of the image 

30 processing applied by the edit processing per- 

formed by said editing means to the video data 
of said clip to be edited, so as to correspond to 
said edit resultant dip; and 
control means for controlling said display 

35 means to display said image processing data 

stored in said storing means which corre- 
sponds to said selected edit resultant dip on a 
display as a part of said graphical user inter- 
face, when said edit resultant clip is selected. 

40 

72. The editing system according to claim 71 , wherein 

said storing means has a clip database to reg- 
ister for each edit resultant dip said image 
45 processing data. 

73. The editing system according to claim 72, wherein 

said plurality of processing modules have an 
so edit module for editing said plurality of dips to 

be edited, a composite module for composing 
said plurality of clips to be edited, and a spedal 
effect module for applying the spedal effects to 
said plurality of dips to be edited. 

55 

74. The editing system according to claim 73, further 
comprising 



66. The editing system according to claim 65, wherein s 

said control means controls said image 
processing means so as to perform the image 
processing in accordance with the interpolation 
parameter interpolated between said first edit io 
parameter and said second edit parameter on 
the video data of said clip to be edited during 
the period from said first editing point to said 
second editing point 
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image processing means for applying to the 
video data of said clip to be edited the image 
processing respectively corresponding to said 
edit module, said composite module, and said 
special effect module. 



edit start point and the edit end point of said 
clip to be edited, and data representing the 
change point of said image processing data 
applied to the video data of said edit resultant 
clip. 



75. The editing system according to claim 74, wherein 

said clip database has the module identification 
information indicating that which of processing 
modules is said edit resultant clip produced 
from. 

76. The editing system according to claim 75, wherein: 

said graphical user interface is composed of a 
graphical user interface for edit processing cor- 
responding to said edit module, a graphical 
user interface for composite processing corre- 
sponding to said composite module, and a 
graphical user interface for special effect 
processing corresponding to said special effect 
module; and 
said control means 

identifies the processing module correspond- 
ing to said selected edit resultant clip based on 
the module identification information registered 
in said clip database; and 
starts up the processing module corresponding 
to said identified processing module and con- 
trols said display means to display the graphi- 
cal user interface of the processing module 
corresponding to said identified processing 
module. 

77. The editing system according to claim 76, wherein 

said clip database has editing point data show- 
ing a plurality of editing points specified in pro- 
ducing said edit resultant clip and image 
processing data showing the contents of the 
image processing performed on the video data 
of said clip to be edited to produce said edit 
resultant clip. 

78. The editing system according to daim 77, wherein 

said control means controls the image process- 
ing timing of said image processing means 
based on said editing point data registered in 
said clip database, and controls the image 
processing operation of said image processing 
means based on said image processing data 
registered in said clip database. 

79. The editing system according to claim 77, wherein 

said editing point data is data representing the 



80. The editing system according to claim 77, wherein 

said image processing data consists of edit 
10 processing data indicating the content of the 

image processing corresponding to the edit 
processing specified by said edit module, the 
composite processing data indicating the con- 
tent of the image processing corresponding to 
is the composite processing specified by said 

composite module, and the special effect 
processing data indicating the content of the 
image processing corresponding to the special 
effect processing specified by said special 
20 effect module. 

81. The editing system according to claim 80, wherein 

said edit data consists of edit processing iden- 
25 trfication data indicating the type of edit 

processing set by said edit module and a plu- 
rality of edit processing parameters corre- 
sponding to the edit processing. 

30 82. The editing system according to claim 81 , wherein 

said edit processing parameters are registered 
in said clip database so as to correspond to 
said editing point specified in said edit resultant 

35 Clip. 

83. The editing system according to claim 82. wherein 

said control means controls said image 
40 processing* means so as to perform on the 

video data of said clip to be edited the image 
processing in accordance with said edit 
processing parameters corresponding to said 
editing point at a timing in accordance with said 
45 editing point. 

84. The editing system according to claim 82, wherein: 

the editing point specified for said edit resultant 
so clip includes the first editing point and the sec- 

ond editing point; 

said edit processing parameters include the 
first edit processing parameter set to a timing 
corresponding to said first editing point and the 
55 second edit processing parameter set to a tim- 

ing corresponding to said second editing point; 
and 

said control means controls said image 
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processing means so as to perform the image 
processing in accordance with said first edit 
parameter on the video data of said clip to be 
edited at a timing of said first editing point, and 
controls said image processing means so as to 5 
perform the image processing in accordance 
with said second edit parameter on the video 
data of said clip to be edited at a timing of said 
second editing point 

10 

85. The editing system according to claim 84, wherein 

said control means controls said image 
processing means so as to perform the image 
processing in accordance with the interpolation 15 
parameter interpolated between said first edit 90. 
parameter and said second edit parameter on 
the video data of said clip to be edited during 
the period from said first editing point to said 
second editing point. 20 

86. The editing system according to claim 81 , wherein 

said control means controls display means to 
display the cell showing the edit section of said 2s 
clip to be edited and the change of said edit 
processing parameters specified for said clip to 
be edited, which correspond to the time axis 
direction. 

30 

87. The editing system according to claim 81 , wherein 

said control means controls said display means 
to display said plurality of edit processing 
parameters set for said selected edit resultant 35 
clip on said display as a part of said graphical 
user interface for edit processing, based on the 
information registered in said clip database. 

88. The editing system according to claim 87, wherein 40 

said control means controls said display means 
to display said edit parameter so as to corre- 
spond to each editing point, in order to visually 
Know the change in the time axis direction of 45 
said plurality of edit processing parameters, 91. 
based on said editing point data and said 
image processing data of said selected edit 
resultant clip. 

50 

89. An editing system for editing a plurality of clips to be 
edited, comprising: 

editing means, which is composed of a plurality 
of processing modules for editing the clips to ss 
be edited, for applying to said clips to be edited 
the edit processing corresponding to the 
processing module selected among from the 



plurality of processing modules to produce edit 
resultant clip; 

managing means for managing said edit result- 
ant dip and said plurality of clips to be edited 
with the hierarchical structure in order to show 
that which of clips to be edited is said edit 
resultant clip produced from; and 
display means for displaying on a display a 
graphical user interface including a tree win- 
dow for showing the link state of a plurality of 
clips managed by said managing means with 
the hierarchical structure, and a time line win- 
dow showing the edit section of said clip to be 
edited on the time axis. 

The editing system for editing a plurality of clips to 
be edited, comprising: 

editing means which is composed an edit mod- 
ule for producing the edit resultant clip by 
applying the edit processing to said clips to be 
edited, a composite module for producing the 
edit resultant clip by applying the composite 
processing to said clips to be edited, and a spe- 
cial effect module for producing the edit result- 
ant clip by applying the special effect 
processing to said clips to be edited; 
user interface means composed of a graphical 
user interface for edit processing correspond- 
ing to said edit module, a graphical user inter- 
face for composite processing corresponding 
to said composite module, and a graphical user 
interface for special effect processing corre- 
sponding to said special effect module; and 
display control means for displaying said 
graphical user interface for edit processing on a 
display when the edit processing is performed 
by said edit module, for displaying said graphi- 
cal user interface for composite processing on 
a display when the edit processing is per- 
formed by said composite module, and for cfis- 
ptaying said graphical user interface for edit 
processing on a display when the edit process- 
ing is performed by edit module. 

An editing system for editing a clip to be edited, 
comprising: 

editing means for producing the edit resultant 
clip by applying the edit processing specified 
by an edit operator on said clip to be edited; 
managing means for managing, with the hierar- 
chical structure, the clip used by said edit 
processing of said editing means and the clip 
produced by said edit processing; and 
control means for controlling said editing 
means based on the information managed by 
said managing means. 
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92. An editing system for producing the edit resultant 
clip by editing the supplied clip, comprising: 

editing means for producing the edit resultant 
clip by applying the edit processing specified 
by an edit operator to the clip to be edited 
which is edit-processed; 
managing means for managing each clip with 
the hierarchical structure by linking said clip to 
be edited to said edit resultant clip as a lower 
dip, or by linking said edit resultant clip to said 
clip to be edited as a upper clip; and 
control means for controlling said editing 
means based on the information managed by 
said managing means. 

93. An editing system for editing the supplied clip, com- 
prising: 

editing means for applying the edit processing 
to the supplied clip; 

managing means for managing all clips used or 
produced by said editing means, with the hier- 
archical structure which is expressed by the up 
and low relation, by linking each other, regard- 
ing the clip to be edit-processed in said edit 
processing as a lower clip and the clip pro- 
duced by the edit processing in said edit 
processing as an upper clip; and 
control means for controlling said editing 
means based on the information managed by 
said managing means. 

94. An editing method for producing the edit resultant 
clip from a plurality of clips to be edited, comprising 
the steps of: 

applying the edit processing corresponding to 
the processing module selected among from a 
plurality of processing modules for editing a clip 
to be edited, to produce the edit resultant clip; 
and 

managing said edit resultant clip and said clips 
to be edited with the hierarchical structure, in 
order to indicate that which of clips to be edited 
is said edit resultant clip produced from. 

95. The editing method according to claim 94, wherein 

said plurality of clips are managed by the clip 
database in which the information relating to 
said plurality of clips are registered for each 
clip. 

96. The editing method according to claim 95, wherein 

the hierarchical structure of said plurality of 
clips is managed by the link information of said 



clip database. 

97. The editing method according to claim 95, wherein 

5 said plurality of processing modules comprise 

an edit module for editing said plurality of clips 
to be edited, a composite module for compos- 
ing said plurality of clips to be edited, and a 
special effect module for applying the special 

10 effects to said plurality of clips to be edited. 

98. The editing method according to claim 97, wherein 

the image processing respectively correspond- 
15 tng to said edit module, said composite mod- 

ule, and said special effect module is applied to 
the video data of said clip to be edited, based 
on the information registered in said clip data- 
base. 

20 

99. The editing method according to claim 98, wherein 

the graphical user interface corresponding to 
each of said edit module, said composite mod- 
25 ule, and said special effect module is respec- 

tively splayed on a display, based on the 
information registered in said clip database. 

100-The editing method according to claim 98, wherein 

30 

said clip database has the module identification 
information representing that which of process- 
ing modules is said edit resultant clip produced 
from. 

35 

101 .The editing method according to claim 100, 
wherein 

said control means starts up the processing 
40 module corresponding to the edit resultant clip 

specified by an edit operator based on said 
module identification information stored in said 
d ip database. 

45 102.The editing method according to claim 100, 
wherein 

said clip database has editing point data show- 
ing a plurality of editing points specified in pro- 
50 ducing said edit resultant dip and image 

processing data showing the content of the 
image processing applied to the video data of 
said clip to be edited to produce said edit 
resultant dip. 

55 

103.The editing method according to daim 102, 
wherein 
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the image processing timing applied to said clip 
to be edited is controlled based on said editing 
point data registered in said clip database, and 
the image processing operation applied to said 
clip to be edited is controlled based on said 5 
image processing data registered in said clip 
database. 

104.The editing method according to claim 102, 
wherein w 



105.The editing method according to claim 102, 
wherein 20 



106. The editing method according to claim 105, 35 
wherein 

said edit processing data consists of edit 
processing identification data indicating the 
type of edit processing set by said edit module 40 
and a plurality of edit processing parameters 
corresponding to the edit processing. 

1 07. The editing method according to claim 106, 
wherein as 

said edit processing parameters are registered 
in said clip database so as to correspond to 
said editing point specified in said edit resultant 
clip. so 

108. The editing method according to claim 107, 
wherein 

said control means performs on the video data ss 
of said clip to be edited the image processing in 
accordance with said edit processing parame- 
ters which correspond to said editing point at a 



timing in accordance with said editing point. 

109. The editing method according to claim 107, 
wherein: 

the editing point specified for said edit resultant 
clip includes the f irst editing point and the sec- 
ond editing point; 

said edit processing parameters include the 
first edit processing parameter set to a timing 
corresponding to said first editing point and the 
second edit processing parameter set to a tim- 
ing corresponding to said second editing point; 
and 

said image processing means is controlled so 
as to perform the image processing in accord- 
ance with said first edit parameter on the video 
data of said clip to be edited at a timing of said 
first editing point, and is controlled so as to per- 
form the image processing in accordance with 
said second edit parameter on the video data 
of said clip to be edited at a timing of said sec- 
ond editing point. 

110. TTie editing method according to claim 109, 
wherein 

the image processing in accordance with the 
interpolation parameter interpolated between 
said first edit parameter and said second edit 
parameter is applied to the video data of said 
clip to be edited during the period from said first 
editing point to said second editing point. 

1 11 .The editing system according to claim 106, wherein 

the cell showing the edit section of said clip to 
be edited and the change of said edit process- 
ing parameters specified for said clip to be 
edited are displayed so as to correspond to the 
time axis direction. 

112. The editing method according to claim 102, 
wherein 

a new edit resultant clip is produced instead of 
the edit resultant clip before modification in 
response to the instruction from an edit opera- 
tor to modify said edit resultant clip, and all 
clips linked to the upper position of the edit 
resultant clip before modification are searched 
based on said link information of said clip data- 
base to make the searched clips disable. 

113. The editing method according to claim 112, 
wherein: 

the information relating to said new edit result- 



said editing point data is data representing the 
edit start point and the edit end point of said 
clip to be edited, and data representing the 
change point of said image processing data 15 
applied to the video data of said edit resultant 
clip. 



said image processing data consists of edit 
processing data indicating the content of the 
image processing corresponding to the edit 
processing specified by said edit module, the 25 
composite processing data indicating the con- 
tent of the image processing corresponding to 
the composite processing specified by said 
composite module, and the special effect 
processing data indicating the content of the 30 
image processing corresponding to the special 
effect processing specified by said special 
effect module. 
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said edit resultant dip newly produced is regis- 
tered in said clip database with the clip identifi- 
cation code or clip name representing said 
searched disable edit resultant dip, and 
5 said searched disable edit resultant dip is reg- 

istered in said clip database with the clip identi- 
fication code or dip name which is different 
from the clip identification code or clip name 
representing said researched disable edit 
10 resultant dip- 



ant dip is registered in said clip database with 
the clip identification code or dip name repre- 
senting sad edit resultant clip before modifica- 
tion; and 

the information relating to said edit resultant 
dip before modif ication is registered in said clip 
database with the dip identification code or clip 
name which is different from the dip identifica- 
tion code or dip name representing said edit 
resultant clip before modification. 

114.The editing method according to claim 113, 
wherein 

said database has the identification flag indi- is 
eating whether said each dip is enable or disa- 
ble. 

115.7he editing method according to daim 114, 
wherein 20 



119. The editing method according to claim 116, 
wherein 

said search process and said production proc- 
ess are repeated until all dips managed with 
the hierarchical structure become enable. 

120. The editing method according to claim 116, 
wherein 



re-execution processing is performed in order said search process searches the edit resultant 

to make the edit resultant dip which has been clip which has the lower clips being all enable 

made disable by said modification processing among said disable edit resultant clips and 

enable in response to the instruction from an 25 which is at the lowest position among said clips 

edit operator. managed with the hierarchical structure, to be 

performed with the re-execution. 

116. The editing method according to claim 115, 

wherein 121 .The editing method according to claim 116, 

30 wherein 

said re-execution processing indudes: 

said production process performs the image 

search process for referring said link infor- processing on the video data of the dip to be 

mation and said identification flag of said linked lowly based on said editing point data 

clip database to search the edit resultant 35 and said image processing data corresponding 

clip to be re-executed among from said dis- to said searched disable edit resultant dip, so 

able edit resultant dips; and as to produce said new video data, 
production process for producing a new 

video data corresponding to said searched 1 22. An editing method of editing a plurality of clips to be 

edit resultant clip among from the video 40 edited, comprising the steps of: 
data of all lower clips linked to the lower 

position of the edit resultant dip searched applying to a plurality of dips to be edited the 

by said search process. edit processing corresponding to the process- 
ing module selected among from the plurality of 

117. The editing method according to daim 116, 45 processing modules to produce edit resultant 
wherein clip; 

storing the module identification information 

in said production process, a new edit resultant indenting that which of processing modules is 

dip is produced instead of said searched disa- said edit resultant clip produced by using from; 

ble edit resultant dip, from said newly produced so and 

video data, said link information, said editing starting up the processing module correspond- 
point data, and said image processing data ing to said edit resultant clip based on said 
relating to said searched edit resultant clip reg- stored module identification data, when said 
istered in said clip database. edit resultant dip is selected. 

55 

118. The editing method according to daim 117, 123.The editing method according to daim 122, 
wherein wherein 
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said module identification information is stored 
by a clip database in which the information 
relating to said plurality of clips are registered 
for each clip. 

124. The editing method according to claim 123, 
wherein 

said clip database includes the link information 
indicating the link state of each clip in the hier- 
archical structure in order to manage said edit 
resultant clip and said plurality of clips to be 
edited with the hierarchical structure. 

125. The editing method according to claim 124, 
wherein 

said plurality of processing modules comprise 
an edit module for editing said plurality of clips 
to be edited, a composite module for compos- 
ing said plurality of clips to be edited, and a 
special effect module for applying the special 
effects to said plurality of clips to be edited. 

126. The editing method according to claim 125, 
wherein: 

the processing module corresponding to said 
selected edit resultant clip is identified based 
on the module identification information regis- 
tered in said clip database; and 
the processing module corresponding to said 
identified processing module is started up and 
the graphical user interface of the processing 
module corresponding to said identified 
processing module is displayed. 

127. An editing method of editing a plurality of clips to be 
edited, comprising the steps of: 

displaying on a display the graphical user inter- 
face corresponding to the processing module 
for editing the clip to be edited; 
applying the edit processing corresponding to 
said processing module to said plurality of clips 
to be edited to produce the edit resultant clip; 
storing the image processing data indicating 
the content of image processing applied to the 
video data of said clip to be edited by the edit 
processing performed by said editing means, 
so as to correspond to said edit resultant clip; 
and 

displaying on a display said image processing 
data stored in said storing means which corre- 
sponds to said selected edit resultant dip as a 
part of said graphical user interface, when said 
edit resultant clip is selected. 



128. The editing method according to claim 127, 
wherein 

said image processing data is stored by the clip 
s database in which the information relating to 

said plurality of clips is registered for each clip. 

129-The editing method according to claim 128, 
wherein 

10 

said plurality of processing modules comprise, 
at least, an edit module for editing said plurality 
of clips to be edited, a composite module for 
composing said plurality of clips to be edited, 
75 and a special effect module for applying the 

special effects to said plurality of clips to be 
edited. 

130.The editing method according to claim 129, 
20 wherein 

the image processing respectively correspond- 
ing to said edit module, said composite mod- 
ule, and said special effect module is applied to 
25 - the video data of said clip to be edited based on 

said image processing data registered in said 
clip database. 

131 .The editing method according to claim 130, 
30 wherein 

said dip database has the module identification 
information indicating that which of processing 
modules is said edit resultant dip produced 
35 from. 

132. The editing method according to daim 131, 
wherein 

40 said graphical, user interface consists of a 

graphical user interface for edit processing cor- 
responding to said edit module, a graphical 
user interface for composite processing corre- 
sponding to said composite module, and a 

45 graphical user interface for spedal effect 

processing corresponding to said spedal effect 
module; and 

the processing module corresponding to said 
selected edit resultant clip is identified based 

50 on the module identification information regis- 

tered in said dip database, the processing 
module corresponding to said identified 
processing module is started up, and the 
graphical user interface of the processing mod- 

55 ule corresponding to said identified processing 

module is displayed. 

133. An editing method of editing the dip to be edited, 
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comprising the steps of: 

applying the edit processing specified by an 
operator to said clip to be edited to produce the 
edit resultant clip; 5 
registering the information for managing with 
the hierarchical structure the clip used in said 
edit processing of said editing means and the 
clip produced by said edit processing; and 
controlling said editing means based on said w 
registered information. 

134. An editing method of editing the supplied clip to 
produce the edit resultant clip, comprising the steps 

of: is 

applying the edit processing specified by an 
edit operator to the clip to be edited which is to 
be edit -processed to produce the edit resultant 
clip; and 20 
managing each clip with the hierarchical struc- 
ture by lining said clip to be edited to said edit 
resultant clip as a lower dip or by linking said 
edit resultant clip to said clip to be edited as an 
upper clip. 25 

135. An editing method of editing the supplied clip, com- 
prising the steps of: 

applying the edit processing to the supplied so 
clip; and 

managing all clips used and produced by said 
edit processing with the hierarchical structure 
which is expressed by the up and low relation 
by lining each other, regarding said clip to be 35 
edited as a lower clip and said clip to be pro- 
duced by said edit processing as an upper clip. 

136. A clip management device for an editing device 
editing the supplied clip, comprising: 40 

editing means for applying the edit processing 
to the supplied clip; and 
managing means for managing with the hierar- 
chical structure said clip to be edited and the 45 
clip produced by said edit processing by linking 
each other, regarding said clip to be edited in 
said edit processing as a lower clip and the clip 
produced by said edit processing as an upper 
clip. so 

137. A clip management method for an editing device 
editing the supplied clip, comprising the steps of: 



managing with the hierarchical structure said 
clip to be edited and said first edit resultant clip 
by linking said clip to be edited to said edit 
resultant clip as a lower clip or linking said edit 
resultant clip to said clip to be edited as an 
upper clip; 

applying the second edit processing specified 
by an edit operator to said first edit resultant 
clip, to produce the second edit resultant clip; 
and 

managing with the hierarchical structure said 
clip to be edited, said first edit resultant clip, 
and said second edit resultant clip, by linking 
said first edit resultant clip to said second edit 
resultant clip as a lower clip or linking said sec- 
ond edit resultant clip to said first edit resultant 
clip as an upper clip. 

138. An editing system for editing the clip to be edited, 
comprising: 

editing means for applying the edit processing 
specified by an edit operator to the dip to be 
edited to produce the edit resultant dip; 
managing means for managing with the hierar- 
chical structure all clips by linking said edit 
resultant clip and said dip to be edited so as to 
be in the up and low relation; and 
control means for controlling said managing 
means, when the content of said edit resultant 
clip is modified, so as to make all dips linked to 
the upper position of said modified edit result- 
ant clip disable based on the information man- 
aged by said managing means. 

139. An editing method for editing the clip to be edited, 
comprising the steps of: 

applying the edit processing specified by an 
edit operator to the dip to be edited to produce 
the edit resultant clip; 

managing with the hierarchical structure all 
clips by linking said edit resultant clip and said 
clip to be edited so as to be in the up and low 
relation each other; and 

when the content of said edit resultant 
clip is modified, making ail clips linked to the 
upper position of said modified edit resultant 
clip disable. 

140- A clip managing method applied for an editing 
device editing the clip to be edited, comprising the 
steps of: 

applying the edit processing specified by an 
edit operator to the dip to be edited to produce 
the edit resultant clip; 

managing with the hierarchical structure all 



applying the first edit processing specified by ss 
an edit operator to the clip to be edited which is 
to be ed'rt-processed, to produce the first edit 
resultant clip; 
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clips by linking said edit resultant clip and said 
clip to be edited so as to be in the up and low 
relation each other; and 

when the content of said edit resultant 
clip is modified, making all clips linked to the 5 
upper position of said modif ied edit resultant 
clip disable. 

141 .An editing system for editing the clip to be edited, 
comprising: 10 

editing means for applying the edit processing 
specified by an edit operator to said clip to be 
edited to produce the edit resultant clip; 
managing means for managing with the hierar- is 
chical structure all clips by linking said edit 
resultant clip and said dip to be edited so as to 
be in the up and low relation each other; and 
control means, when the content of said edit 
resultant clip is modified, for controlling said 20 
editing means to newly produce said modified 
edit resultant dip and all edit resultant dips 
linked to the upper position of said modified 
edit resultant dip disable, based on the infor- 
mation relating to the hierarchical structure 25 
managed by said managing means. 

142. An editing method for editing the clip to be edited, 
comprising the steps of: 

30 

applying the edit processing specified by an 
edit operator to said dip to be edited to produce 
the edit resultant dip; 

managing with the hierarchical structure all 
dips by linking said edit resultant dip and said 35 
clip to be edited so as to be in the up and low 
relation each other; and 
newly produdng said modified edit resultant 
clip and all edit resultant clips linked to the 
upper position of said modified edit resultant 40 
clip. 
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